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ABSTRACT 


Unmanned Aerial Systems (UAS) are playing a signifieant role in the Global War 
on Terrorism (GWOT). Until reeently, small UAS (SUAS) were an insignificant part of 
these efforts. Now their numbers exceed those of their larger counterparts by an order of 
magnitude. Future projections anticipate a growing demand for SUAS making now the 
best time to examine the functions they perform in order to make better decisions 
concerning their future design and development. This thesis provides a brief history of 
UAS and discusses the current capabilities and mission areas in which they perform. 
Their relevance to modern warfare and assumptions concerning their future roles on the 
battlefield is presented. Predominant UAS missions are identified, as well as the 
technical requirements deemed necessary for their success. A generic UAS functional 
model is developed to illustrate where the challenges and technology gaps manifest in 
SUAS design. Possible technology solutions that could fill these gaps are presented and 
a field experiment is conducted to demonstrate the feasibility of several possible 
solutions. The goal of this thesis is to identify existing technology gaps and offer 
technology solutions that lead to better design of future SUAS flight and mission control 
support systems (FMCSS). 
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I. INTRODUCTION 

A. MISSION STATEMENT 

Unmanned Aerial Systems (UAS) are playing a significant role in the Global War 
on Terrorism (GWOT) and new missions are regularly generated for UAS as their 
capabilities continue to increase. Small UAS (SUAS) are quickly taking on a larger role 
in the GWOT and this trend is expected to continue. The capability of any given UAS 
determines the types of missions it can accomplish. These missions vary widely from 
Intelligence, Surveillance, Reconnaissance (ISR), precision target location, 
chemical/biological detection and measurement, force protection, combat search and 
rescue (CSAR), etc. The U.S. government, and hence the American public will spend 
considerable amounts of money to advance and leverage the potential of all UAS. In 
light of this, and the ever constrained budgets of the Department of Defense (DoD), 
developers and designers of UAS must strive to provide the most capability for the least 
amount of money, i.e., the most “bang-for-the-buck,” when these systems are ultimately 
implemented. 

The strengths and weaknesses of UAS are a function of numerous known and 
unknown parameters such as aerodynamics of the UAV itself, sensor performance, 
ground control station (GCS) user interface, operator skill, weather conditions, radio 
control signal quality, etc. Knowledge of these strengths and weaknesses permits the 
development of technical requirements that enable UAS to effectively execute any given 
mission. This thesis will take a high level look at SUAS. An examination of the 
predominant missions and capabilities required in order to effectively execute those 
missions will be made followed by a discussion of the technical requirements needed to 
enhance the chances for mission success. Challenges impeding or preventing SUAS 
from being as effective as possible, such as high cost or unproven technology, are 
addressed along with recommendations to mitigate their effects. The goal of this thesis is 
to identify existing technology gaps and offer possible technology solutions that will aid 
the design of future flight and mission control support systems (FMCSS) for SUAS. 

This thesis consists of three parts. The first. Chapters I and II, provides general 
background information on military UAS. Historical achievements over the past 40 years 
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are highlighted and their eurrent mission areas and eapabilities are introdueed. The 
relevance of UAS in modern warfare is discussed including the growing significance that 
small UAS (SUAS) are playing in the GWOT. Warfighter requirements for UAS, and 
the priorities they give to various missions is documented. Part I also presents the 
assumptions made concerning future UAS development and the methodology followed in 
writing this thesis. 

The second part, Chapters III through V, starts with a discussion of the challenges 
facing modern SUAS. Predominant UAS missions are presented in addition to the 
technical requirements deemed necessary for their success. A matrix of UAS missions 
versus functions is presented as a segue into the final chapter that concludes with a 
generic SUAS functional model illustrating UAS subsystems and the functions they 
perform. 

Part three. Chapters VI through X, begins with a discussion of selected 
technology gaps that prevent SUAS from performing in an optimal fashion. This is 
followed by a chapter that identifies possible current and future technologies that could 
be utilized to address these gaps. Several possible technology solutions are investigated 
during a field experiment to demonstrate their feasibility. The thesis concludes with 
lessons learned and recommendations for the design of future SUAS Flight and Mission 
Control Support Systems (FMCSS). 

B. BACKGROUND 

The military role of UAS is growing at unprecedented rates. Within the last 
calendar year, tactical and theater level unmanned aircraft (UA) alone, had flown over 
100,000 flight hours in support of Operation ENDURING FREEDOM (OEE) and 
Operation IRAQI EREEDOM (OIE).i Rapid advances in technology are enabling more 
and more capability to be placed on smaller airframes which is spurring a large increase 


1 Testimony of Mr. Dyke Weatherington, Deputy, UAS Planning Task Foree, before the Flouse of 
Representatives Committee on Transportation and Infrastrueture, Subeommittee on Aviation; Mareh 29, 


2006. 


2 



120000 


100000 


80000 


S" 

o 

X 


60000 


O) 

iZ 


40000 


20000 


Does not include Small DAS 




nR 





1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 


□ AIR FORCE ■ ARMY ■ NAVY & USMC 


Figure 1. DoD UAS Flight Hours (From; Office of Secretary of Defense) 


in the number of SUAS being deployed on the battleheld. The use of SUAS in combat is 
so new that no formal DoD wide reporting procedures have been established to track 
SUAS flight hours. As the capabilities grow for ah types of UAS, nations continue to 
subsidize their research and development leading to further advances enabling them to 
perform a multitude of missions. UAS no longer only perform intelligence, surveillance, 
and reconnaissance (ISR) missions, although this still remains their predominant mission. 
Their roles have expanded to areas including electronic attack (EA), strike missions, 
suppression and/or destruction of enemy air defense (SEAD/DEAD), network node or 
communications relay, combat search and rescue (CSAR), and derivations of these 
themes. UAS range in cost from a few thousand dollars to tens of millions of dollars, and 
the aircraft used in these systems range in size from a Micro Air Vehicle (MAV) 
weighing less than one pound, to large aircraft weighing over 40,000 pounds. 

C. UAS RELEVANCE 

The term “UAS” is relatively new and reflects the new perception given to a 
system that was once only thought of in terms of the unmanned vehicle itself. During the 
1950s these “systems” were used as targets for other weapons, usually missiles, to shoot 


3 


















at, and referred to as drones. They were also being deployed as deeoys with a boxy 
design in order to give them a radar eross seetion much like that of their B-52 mother 
ships. Some were fitted with active radar reflection enhancement devices, as well as 
chaff and flare dispensers to further confuse enemy defenses. These decoys were also 
equipped with an autopilot system that could be programmed for one change of speed and 
two turns. The success of drones and decoys naturally led to more advanced missions. In 
1959, Ryan Aeronautical began testing to evaluate the viability of using UAS for 
reconnaissance missions. These efforts led to the deployment, in 1964, of an Air Force 
reconnaissance UAS called Lightning Bug to take pictures over China. Two Lightning 
Bugs were launched from a DC-130 to fly over China and back to Taiwan where they 
would be recovered from a rice patty field after deployment of parachutes. One of the 
Lightning Bugs failed to launch and the other one was badly damaged after splashdown 
when it was dragged over the ground by its parachute. The navigation of these unmanned 
aircraft was not as accurate as predicted, but the film payload was recovered intact and 
images of several primary targets were recovered. Lightning Bugs were also used by the 
U.S. Navy over Vietnam to conduct reconnaissance missions. 



Figure 2. Lightning Bug UAS (From; Unmanned Aerial Vehicles (UAVs) An Assessment 
Of Historical Operations And Future Possibilities; Maj. Christopher A. Jones, 
USAF; Air Command and Staff College, Research Paper, March 1997) 

After Vietnam, the use of UAS in the U.S. military rapidly declined. It has taken 
over two decades for UAS to reemerge as a significant player in the U.S. military. 
However, recent battlefield successes have practically ensured their long term survival. 
During Desert Shield/Storm, the Pioneer, a derivative of an Israeli surveillance and 
reconnaissance UAS, played a crucial role for Army, Navy and Marine Corps battlefield 
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commanders. They were so effective that Iraqi troops began to associate the sound of the 
UAV’s two-cycle engine with an imminent destructive bombardment. UAS operations 
throughout the conflict led to the first recorded instance of soldiers surrendering to a 
robot. 



Figures. Pioneer UAS 

During Operation Iraqi Freedom (OIF), UAS have continued to play an important 
role becoming the most-requested capability among combatant commanders in Southwest 
Asia according to the deputy director of the Pentagon's UAS planning task force^. In 
terms of raw numbers, there is an order of magnitude more small UAVs (SUAV) in the 
battlespace compared to the larger tactical and theater-level UAVs. As of this writing, 
DoD has a force of over 2600 SUAVs and over 300 tactical and theater-level unmanned 
aircraft (UA) supporting military operations worldwide.^ The most prevalent UAS in the 

2 Unmanned Aircraft Gain Starring Role in Terror War, News article by Donna Miles, American 
Forces Press Service, November 9, 2004. 

3 Testimony of Mr. Dyke Weatherington, Deputy, UAS Planning Task Force, before the Flouse of 
Representatives Committee on Transportation and Infrastructure, Subcommittee on Aviation; March 29, 
2006. 
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Iraqi theater is the SUAS called Raven. It functions primarily as an intelligence, 
surveillance and reconnaissance platform that provides warfighters real-time, over-the- 
horizon views of trouble spots. It is a hand-held system that packs into a transit case 
which can fit into the back of a High Mobility Multipurpose Wheeled Vehicle 
(HMMWV). 







Figure 4. Hand-Launching Raven 

D. ASSUMPTIONS 

UAS will continue to be a major player in the current Global War on Terrorism 
(GWOT) and battlefield commanders will increasingly request their capabilities. 
Advances in materials technology and computer hardware and software will significantly 
increase the capabilities available in UAS. Advances in microelectronics will particularly 
benefit SUAS since computer hardware components will become lighter permitting their 
installation on the smaller UAV platforms. New software solutions will need to be 
developed to exploit the increasing capability made available by the new computer 
hardware components. This rapid technology growth will accelerate government 
spending on UAS (Figure 5) and beg leadership to find ways to standardize components 
and operational procedures to keep these systems within affordable windows. At some 
point the cost of SUAS may reach the point that the SUAV become an expendable part of 
the overall system. 


6 









Figure 5. DoD Annual Funding Profile for UAS (From; UAS Roadmap, 2005) 

E. METHODOLOGY 


Researeh will be eondueted on the existing literature that pertains to military 
UAS. This researeh will uncover the most important and most probable missions that 
UAS are currently performing. It will determine the most likely missions these systems 
will be called upon to perform in the future. The capabilities required or desired to 
perform these missions will be discovered through literature review and interviews with 
subject matter experts (SME). A mission versus functions matrix will be presented as a 
guide to ascertain the technology requirements necessary to effectively perform the most 
likely missions of UAS with an emphasis on missions performed by SUAS. A “hands- 
on” field experiment conducted at McMillan Airfield on Camp Roberts California 
National Guard Training Site to test a possible future SUAS technology is presented. 
Based on the research findings in this thesis, systems engineering methodology is applied 
to develop functional requirements from the mission needs that were documented in the 
literature review, SME interviews, and Camp Roberts field experiment. 
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II. UAS MISSION AREAS AND PRIORITIES 


A. BACKGROUND 

UAS have proven their ability to be foree multipliers—that is, devices that 
improve effectiveness in combat without requiring more forces or that enable 
commanders to accomplish missions with fewer forces. History has validated the worth 
of UAS, large and small, in a variety of different roles. This chapter will briefly examine 
the historical roles of UAS within the last 40 years in the U.S. military and then move on 
to examine the current capabilities and predominant missions that UAS provide today. 
COCOM requirements and priorities are also investigated as their input comes directly 
from the warfighters actually using UAS today. Their experiences and feedback will 
provide the direction and focus needed to design the next generation flight and mission 
control support systems (FMCSS). 

B. HISTORICAL UAS MISSION AREAS 

There exists a strong correlation with past UAS missions and the missions 
currently being filled by UAS today. Over the past 40 years, the Services have 
extensively utilized UAS to provide five variations of the intelligence, surveillance, and 
reconnaissance (ISR) role. This consistency indicates that the underlying requirements 
are long-term, and there is no reasonable reason to expect that this trend will cease. 
Table 1 illustrates the historically validated roles of UAS. 


UAS Role: 

Brigade/division asset for RSTA 


Piopouent: 

Amiy. Marine Coips 


Heritage: 

Falconer (1950-60s) — Aquila (1970-80s) — Pioneer (1980-2000s)-Dragon Drone 
(1990s) - Outrider (1990s) - Shadow 200 (2000s) 

UAS Role: 

Shipborne asset for recomiaissance and weapon support 


Proponent: 

Nar^y 


Heritage: 

DASH (1960s) — Project Blackfly (1970s) — Pioneer (1980-2000s) — Fire Scout 
(2000s) 

UAS Role: 

Small unit asset for over-the-hill recomiaissance 


Proponent: 

Marine Coips 


Heritage: 

Bikini (1960s) - Pointer (1980-90s) — Dragon Eye (2000s) 

UAS Role: 

Surcivable asset for strategic penetrating recomiaissance 


Proponent: 

Anny/Air Force/Nai'y 


Heritage: 

Osprey (1960s) — D-21 (1960s) — Classified Piogiani (1980s) — DarkStar (1990s) — 
JUCAS (2000s) 

UAS Role: 

Hiali altimde endurance asset for standoff recomiaissance 


Proponent: 

Air Force 


Heritage: 

Compass Anow (1960s) — Compass Dwell (1970s) — Compass Cope (1970s) — 

Condor (1980s) - Global Hawk (1990-2000s) 


Table 1. Historically Validated UAV Roles (From UAS Roadmap, 2005) 
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C. CURRENT UAS MISSION AREAS 

ISR utilizing electro-optical (EO), infrared (IR) and more recently, small aperture 
radar (SAR) sensors, have been the historically predominant roles or mission areas of 
UAS over the last 40 years. The GWOT, however, has demonstrated the value of UAS in 
many other mission areas not strictly related to ISR. Table 2 on the following page 
shows a list of 15 other mission areas, in addition to ISR, where UAS have flown in 
proof-of-concept demonstrations. Notice that the list gives a demonstration of UAS 
based on whether the mission is “dull,” “dirty” and/or “dangerous.” An example of a 
“dull” mission could be a very long ISR mission such as a no-fly zone patrol. It is 
important to point out, however, that although the UAS sensors may be just as alert in the 
last hour of its patrol as it was in the first hour, this may not alleviate the dull aspect of 
the mission since a human operator may still be required to monitor and evaluate the 
incoming intelligence data. The underlying assumption of good FMCSS design is that 
cognitive aids would be available to identify situations of interest that would help to 
mitigate the “dullness.” “Dirty” missions (and also dangerous) could involve flights into 
airspace potentially contaminated with biological or chemical agents. These areas would 
be avoided if possible, but if the mission was important enough, the UAV could operate 
in areas impossible for manned aircraft and either be decontaminated or discarded at 
mission completion. An example of a “dangerous” mission, but not considered “dirty” is 
the electronic attack (EA) mission. EA missions are often performed early in a battle 
while the enemy’s air defenses pose a serious threat. 

D. REQUIREMENT OF UAS 

Each year every COCOM submits an integrated priority list (IPE) of requirements 
identifying gaps in the warfighting capabilities within their Area of Responsibility 
(AOR). At SECDEE direction, the latest list identifies capability gaps reflective of the 
five 2002 QDR-defined “operational risk” categories of battlespace awareness (BA), 
command and control (C2), focused logistics (EE), force application (EA), and force 
protection (EP)^. The latest IPE, covering fiscal years 2006 through 2011, specifies 50 
gaps, 27 of which (54 percent) are currently, or could potentially be, addressed by UAS. 


^ Unmanned Aircraft Systems Roadmap 2005-2030, 4 August 2005, Office of the Secretary of 

10 



Requirements 

Justification for UA Use 

UA Experience 

(Mission Aieas) 


PiWH 

■Dangerous' 

(UA Payload. Place Demoiisnated. Yeai) 

ISR 

X 


X 

Pioneer, Exdione, Pointer/Gulf Wai', 1990-91 
Piedator, Pioneer Bosma, 1995-2000 

Himter, Piedator, Pioneer Kosovo, 1999 

Global Hawk. Predator, /Afghanistan. Baq 
2003 - Present 

Himter. Pioneer. Shadow h'aq-2003-Present 

C2 Coimmmications 

X 



Himter/CRP, 1996, Exdione TRSS, 1998 
Piedator ACN, 2000 

Force Protection 

X 

X 

X 

Camcopter, Dragon Drone Ft Simmer, 1999 
FPASS, Dragon Eye, Pointer, Raven. Scan 
Eagle haq -Resent 

SIGINT 

X 


X 

Pioneer SMART, 1995 

Himter LR-100 COMINT, 1996 

Himter ORION, 1997 

Global Hawk Gennan Demo, 2003, haq. 

2004 - Present 

Weapons of Mass 
Destniction (WWID) 


X 

X 

Pioneer RADIAC LSCAD SAWCAD. 1995 
Telemaster Anahte 2000, 1996 

Pointer CADDIE 1998 

Himter SAFEGUARD, 1999 

Tlieater An Missile 
Defense (TAMD) 

X 


X 

Israeh HA-10 development, (canceled) 

Global Hawk study, 1997 

SEAD 



X 

Himter SMART-V, 1996 

Himter LR-100IDM. 1998 

J-UCAS TBD 

Combat Search and 
Rescue (CSAR) 



X 

Exdrone Woodland Cougar Exercise, 1997 
Exdione SPUDS, 2000 ^ 

Mme Coimter Measines 
(MCM) 



X 

Pioneer/COBRA. 1996 

Camcopter/AAMIS. 1999 (Gennany) 

Meteorology,' and 
Oceanography (METOC) 

X 

X 

X 

Aerosonde Visala. 1995 

Piedator T-Drop, 1997 

Predator BEKVTNT ACTD, 2002 

Coimter Narcotics (CN) 

X 


X 

Predator Ft Huachuca. 1995 

Pioneer So. Cahfonua. 1999 

Himter, Shadow Ft Hiuachuca, 2003-2004 

Psychological Ops 



X 

Tern Leaflet Dispensing, 2004 

All Weather Night Stiike 



X 

DASH Vietnam. 1960s 

Piedator Afghamstan haq, 2001 

Global Hawk haq. 2003 

Exercise Support 

X 



PredatorTomt Operational Test Bed Svstem 
(JOTBS), 2002 

Anti Submarine Waifaie 

X 



DASH. 1960s 

Navigation 

X 



Himter GPS Pseudohte, 2000 

Table is not all inclusive 


Table 2. UAS Mission Areas (From UAS Roadmap, 2005) 

Defense, p. 43. 
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Table 3 from the 2005 Roadmap shows the COCOM priorities for the 27 capability gaps 
on a 1-8 priority scale. 


Priority 

CENTCOM 

EUCOM 

JFCOM 

NORTHCOM 

NORAD 

PACOM 

SOUTHCOM 

SOCOM 

STRATCOM 

STRACOM 



Table 3. IPL for UAS-Related Applications by COCOM 


Solid colored blocks indicate missions that UAS perform today and shaded blocks 
indicate functions that are under development. It should be observed that every COCOM 
places UAS applications in the top half of his/her priority list. Additionally, UAS 
applications are the #1 priority in five of nine COCOM including NORAD, and every 
mission currently performed by UAS (solid blocks) is listed within the top three priority. 
Clearly, UAS have been proving their value in modern warfare and will increasingly do 
so as their functionality improves. 

E. UAS MISSIONS 

I. SurveUlance, Target Acquisition and Reconnaissance (STAR) 

Surveillance, Target Acquisition and Reconnaissance (STAR) are by far the 
predominant missions of UAS today. As mentioned in Chapter I, these missions date 
back to the Lightning Bug UAS used in 1964 over China and shortly thereafter in 
Vietnam. STAR missions can be described in terms of three categories: “standoff,” when 
missions are conducted while recognizing the sovereign airspace of other countries; 
“overflight,” when missions are flown in the sovereign airspace of another nation, with or 
without consent, but at low risk to the mission; and finally, “denied,” which is similar to 
“overflight” except the nation-state being flown against possesses a credible capability to 
deny access to their territory^. Strategic national assets such as satellites are also used for 

^ Unmanned Aircraft Systems Roadmap 2005-2030, 4 August 2005, Office of the Secretary of 
Defense, p. A-2. 
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“denied” missions but they have the disadvantage of predietability. UAS ean augment 
satellites by showing up unwarned at unpredietable times allowing eommanders to eolleet 
information when an adversary least expeets it. 

Standoff missions are usually eondueted during peaeetime. They are also used 
when the probability of vehiele loss or politieal ramifieations are too great to risk the 
exposure of the UAV to deteetion. To aehieve the effeet of persistence, the UAV must 
have the capability to remain on station for long periods of time. Often broad areas need 
to be covered requiring high altitude flights with long range sensor performance. In these 
cases, larger UAVs capable of long endurance and the ability to carry heavier payloads 
are needed. These systems may be significantly hard pressed to collect weak 
electromagnetic signals or take high resolution photographs due to a large standoff 
distance. In these cases SUAS can place sensors closer to the desired area of interest and 
thus increase chances of mission success may be the best option. These missions 
essentially become that of an overflight mission discussed next. 

Overflight missions occur with or without the knowledge and/or consent of 
another state or entity being monitored. Many overflight missions are being conducted 
today in both Afghanistan and Iraq in support of the GWOT. The UAV may fly at high, 
medium or low altitudes depending on the particular situation. If persistence is needed 
and image resolution or signal collection can be accomplished from high altitude, then a 
larger high altitude long endurance (HALE) platform such as the Global Hawk or 
Predator could be chosen. If poor weather prevents operation from high or medium 
altitude then a SUAS could be utilized. There is no particular standard platform to use 
when conducting overflight missions as there are for standoff and denied access missions. 

Denied access missions are generally used in support of combat operations or 
national security requirements. In many cases satellites can be used, but as mentioned 
earlier, the disadvantage with satellites lay in their predictability. An adversary can 
prevent data collection or deliberately deceive intelligence gatherers by placing targets or 
signals in the area of interest precisely when a satellite is scheduled to reconnoiter. 
Manned systems, most notably the U-2 and SR-71, and more recently the EP-3, have also 
been used for denied access missions. The drawback with these platforms he in their 
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potential risk of losing the airerew and/or an expensive aireraft as well as the adverse 
politieal fallout that eould result from its deteetion or eapture. UAS mitigate most of 
these eoneems; they ean arrive unwarned, have no erew to plaee in danger, are mueh less 
expensive than their manned eounterpart and, being unmanned, they pose signifieantly 
less diplomatie eonsequenees if eaptured. The 2003 Defense Seienee Board and 2003 Air 
Foree Seientifie Advisory Board results both reported that a UAS eapable of unwarned 
eolleetion is needed by DoD. 

The idea of using SUAS for STAR missions, while not new, is still an emerging 
eoneept worthy of greater study. Eneouraging results have been aehieved using SUAVs 
to eolleet against weak signals and to obtain high resolution images. Definitive answers 
have not been determined to deeide if multi-mission, versus dedieated mission, platform 
designs are the most eost effeetive approaeh for every applieation. It is expeeted that 
opportunities whieh take advantage of growing eommereial markets will yield the best 
value to DoD and ultimately to the taxpayers. 

2. Electronic Attack (EA) 

Eleetronie Attaek (EA) is the use of eleetromagnetie (EM) energy to reduee the 
effeetiveness of RADAR systems to allow flight of aireraft without harm from radars and 
assoeiated missiles. In this eontext, EA of an integrated air defense system (IADS) ean 
be eonsidered to be part of disruptive SEAD diseussed in the next seetion. EA ean be 
aehieved by either distraeting a RADAR with eonfusing or deeeptive information, or by 
blinding the RADAR making it unable to deteet, traek, engage, or destroy threats.^ 

Only reeently have UAS been used to eonduet EA. Prior to this, EA involved 
speeially designed manned aireraft sueh as the Navy EA-6B Prowler and the Air Eoree 
EE-lll Raven. Beeause UAS ean aehieve theoretieally higher levels of survivability 
than manned aireraft, they offer a desirable alternative for eondueting EA missions to 
manned aireraft. SUAS are also well suited for EA attaek missions due to their small 
size. They are naturally stealthy making them less suseeptible to deteetion and more 
likely to get elose up to an adversary’s radar. Current researeh is being eondueted at NPS 
on a Morphing Miero Air and Eand Vehiele (MMALV) that ean fly and erawl up to a 

^ Cooperative Eleetronie Attaek using Unmanned Air Vehieles, Mark J. Mears, 2006, Air Foree 
Researeh Laboratory, Air Vehieles Direetorate, Wright Patterson AFB 
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predetermined target (Figure 6). Getting close to a radar antenna significantly reduces 
the amount of power required to interfere with the radar system. Using UAS to perform 
EA missions will likely require more autonomy than most UAS currently have. 
Desirable capabilities would include the ability to operate and handle aircraft related and 
mission-related contingencies while unable to communicate with the MCS due to self¬ 
jamming and beyond line-of-sight (BEOS) operations. 



Eigure 6. NFS MMAEV (Erom; wingspan < 30.5cm, weight < 45Og) 

3. Strike/SEAD 


On Eebruary 21, 2001 an Air Eorce Predator UAV made history by successfully 
aiming and launching a ‘live’ Hellfire-C, laser-guided missile that struck an unmanned, 
stationary Army tank on the ground at Indian Springs Air Eorce Auxiliary Airfield near 
Nellis Air Eorce Base, NV. Since then, the RQ-1 Predator has been modified to 
accomplish a ground attack role as well as reconnaissance and was redesignated the MQ- 
IB Armed Predator. On November 4, 2002 in Yemen, a Predator UAV was used to drop 
a Hellfire missile which destroyed a civilian vehicle carrying six suspected Al-Qaida 
terrorists one of whom was a key suspect in the October 2000 attack on the U.S. Navy 
destroyer Cole. Due to the endurance and surveillance capability required to successfully 
carry out these missions, some have referred to such missions as a subset of the strike 
mission and have called it “armed reconnaissance.” Either way, it is the strike capability 
that clearly differentiates these missions from others. They provide an attractive 
alternative to manned aircraft because they eliminate the risk of the loss of an aircrew. 

Strike mission targets may be heavily or lightly defended and the level of the 
adversarial threat determines the characteristics most important in the UAS to carry out a 
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strike mission. If the target is heavily defended, survivability is paramount. The system 
design would trade payload and endurance characteristics for attributes that increase its 
probability of success against highly defended targets. For targets less heavily defended, 
more emphasis would be justified on payload (sensors) and endurance which would lead 
to the most efficient “kill” capability. Currently, no SUAS have been designed to carry 
out strike missions. 

SEAD missions can be either destructive or disruptive. In military doctrine, 
destructive SEAD means destruction of the target in a permanent way and has the 
appropriate acronym DEAD for destruction of enemy air defense. When the mission 
calls for neutralizing a radar temporarily, it is called disruptive SEAD. Destructive 
SEAD missions could be considered a subset of a strike mission and disruptive SEAD 
missions could be considered a subset of the EA mission. The characteristic that 
differentiates the SEAD mission from strike or EA is the target. 

SEAD are categorized as either pre-emptive or reactive. Pre-emptive SEAD 
describes employment of the UAS prior to a strike aircraft’s arrival. Its job is to suppress 
or destroy the enemy’s air defenses in order to protect the strike aircraft from surface to 
air attack. Reactive SEAD missions involve the rapid suppression or destruction of 
enemy air defenses that become visible, or “pop-up,” during mission execution. 
Regardless of mission type, to be effective the UAV will have to “close-in” on the enemy 
threat. Attributes of speed, maneuverability and stealth will be highly desired to enhance 
vehicle survivability. Various design criteria deserve future study to determine the ideal 
combination of capabilities required for destructive SEAD missions. 

The 2005 UAS Roadmap has identified several characteristics that UAS 
accomplishing pre-emptive SEAD missions should have and are presented below.^ 

• Extremely high mission reliability, as follow-on force assets (many of 
which will be manned) will depend upon the protection of a SEAD UA 
asset. 

• Battle damage assessment (BDA) so operational commanders can properly 
determine whether strike “go/no-go/continue” criteria have been met. 

^ Unmanned Aircraft Systems Roadmap 2005-2030, 4 August 2005, Office of the Secretary of 
Defense, p. A-6. 
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• If BDA is organic this reduces the relianee on other systems 
outside the SEAD UA platform, but puts other design requirements 
on the SEAD UA that complicate signature control. 

• If BDA is not organic then this simplifies the SEAD UA design 
requirements, but eomplieates the integration of other ISR 
eapabilities as a family of systems attempting to aehieve effeet in 
the SEAD mission. 

• Weapons optimized for eoneept of employment. If using direet attaek 
munitions (short range), then a robust signature reduction design, or stand¬ 
off weapons with appropriate support from on-board or off-board sensors 
to find, fix, traek and target intended threats must be employed. 

• The use of direet attaek munitions is a major eost avoidanee eompared to 
the integration and use of stand-off weapons. 

• However, stand-off weapons provide an opportunity to relax signature 
design requirements and thus avoid signifieant low-observable costs. 

Execution of the reaetive SEAD mission implies further design eriteria: 

• Enemy defensive systems’ operations must be deteeted rapidly implying 
an onboard eapability to deteet threats, or a well integrated system of 
systems. 

• Reaction time from detection to neutralization of the enemy defenses must 
be very short (seeonds). 

• When using weapons to neutralize defenses, the flight time of the weapon 
must be redueed by the ability to stand in elose to the target (high 
survivability) or by the use of a high-speed weapon. 

• Robust, anti-jam, data links are required. 

• Reactive SEAD will require low latency human interaction with the 
system - or high autonomy within the system for determination of ROE 
eriteria. 

• Reaetive SEAD implies the integration of manned and unmanned aireraft 
in a single strike event. 

4. Network Node/Communications Relay 

Multiple UAS have the ability to provide non-line-of-sight (NEOS) 
eommunieation links to ground units, and thus have the ability to provide value to 
operational and tactical level eommanders. UAVs ean act as flying network nodes with 
having the eapaeity to relay large quantities of data. For example, it is possible using 
small (-'8 in.) direetional antennas, to exehange about 10 gigabits per seeond (Gbps) 
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between high-altitude UAVs and surface stations, over typical slant ranges, using only 1 
W of radiated power^. 

UAS conducting Network node/Communications Relay missions must be capable 
of flying at sufficient altitude in order to maintain a link for the duration of the mission. 
There must be sufficient redundancy built in to the system to provide continuous 
connectivity and the vehicle must be capable of generating adequate power, perhaps 
through the use of solar arrays, to provide the required data throughput capacity. Radio 
line of sight (LOS) increases with sensor height i.e., aircraft altitude, as shown Figure 7 
below. Medium and high altitude UAVs have the ability to fly above bad weather and 
maintain communication with each other while hundreds of miles apart. 



Figure 7. Radio LOS vs. Altitude (From: Miniature UAV’s & Future Electronic Warfare, 
Dr Anthony Finn, Dr Kim Brown, Dr Tony Lindsay; Technical Paper, October 

2002 .) 


^ Autonomous Vehicles in Support of Naval Operations, The National Academies Press, 2005, p. 39. 

18 














































Network node/communications relay missions are relatively new for UAS but 
rapid progress is being made in this area. For example, in 2004, a long-enduranee tactical 
UAV, the ScanEagle, successfully demonstrated the ability to relay high-speed wireless 
communications. Streaming video and voice-over IP communication was sent from a 
GCS over a secure high-bandwidth network to the ScanEagle 18 miles away. The data 
was then instantaneously relayed to ground personnel six miles from the ElAV.^ Other 
development work underway includes trials to use Global Hawk, a HAEE LIAS, and 
Predator, a MAE UAV, as airborne communications nodes to shorten sensor to shooter 
timelines utilizing beyond line of sight connectivity.lo Due to the broad user base that 
could have access to network node/communications relay missions, the 2005 Roadmap 
predicts that any airborne communications node is likely to be a “Joint Program.” It 
further states that the inclusion of legacy formats and architectures will be established in 
any approved requirements document and receive input from the Assistant Secretary of 
Defense for Network Integration.! i 


9 Boeing news release dated 21 Deeember, 2004; aeeessed 29 May 2006 at 
http ://www.boeing.eom/news/releases/2004/q4/nr_04122 In.html 

!!* Mission Applieations and Coneepts of Operations, R.A. Frampton, 2003. 

!! Unmanned Aireraft Systems Roadmap 2005-2030, 4 August 2005, Offiee of the Seeretary of 
Defense, p. A-8. 
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2 radios 

connected for relay 



1. Operator sends frequency select command 
to both radios in the UAV. 

= reserved relay frequency 
/j = assigned tactical user frequency 


Figure 8. Communications Relay (From; Joint Unmanned Aerial Vehicle in Time-Sensitive 
Operations Joint Test and Evaluation Final Report, March 2005.) 

5. Combat Search and Rescue (CSAR) 

Joint Publication 3-50.21 discusses joint tactics, techniques, and procedures 
(TT&P) for combat search and rescue (CSAR) and defines CSAR as reporting, locating, 
identifying, recovering, and returning isolated personnel to the control of friendly forces 
in the face of actual or potential resistance. CSAR missions can become complex 
requiring the coordination of multiple participants of different services and hence the 
planning for these missions is accomplished at the Joint Search and Rescue Center 
(JSRC) under the direction of the Joint Force Commander (JFC). Integration of UAS 
into CSAR missions is so new (or Joint Pub 3-50.21 so old) that the Joint Publication 
does not even refer to UAS in their execution. 

In general, UAS performing CSAR missions perform tasks similar to those 
involved in STAR missions. Their targeting capability is used to locate and provide the 
coordinates of the missing forces or indicate safe helicopter landing zones, parachute 
landing zones, or drop zones. If the isolated personnel are equipped with man-pack 
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radios, the UAV, acting as a network node, could become a communication relay 
allowing the isolated personnel to communication with the JSRC. 

SUAS could be used for CSAR missions at the small unit level requiring little or 
no coordination with higher headquarters. Their small size makes them difficult for the 
enemy to target and would not give away the friendly force’s location. SUAS can help 
squad and platoon sized units search greater areas of terrain than would otherwise be 
possible in the same time with ground patrols. Their “eyes in the sky” vantage point also 
makes it easier to locate wreckage that might be missed on foot. In the future, it is 
expected that multiple SUAS operating in a coordinated net-centric environment will 
provide effective CSAR mission capability to commanders at both the tactical and 
operational levels. 

Operating SUAS for CSAR missions does present limitations. SUAVs are limited 
by endurance and their lower altitudes may present larger acoustic and visual signatures 
making them susceptible to attack by man-portable air defense systems or otherwise 
alerting the enemy to friendly force locations. It is worth noting, however, that detection 
of SUAVs is still not easy even when looking for them. Discussion with operators and 
personal experience has revealed that it is difficult to hear SUAVs (gasoline or electric 
powered) even as low as 500 feet. One operator reported that after hearing a SUAV—the 
electric powered CyberBug; it was very hard to detect with the naked eye at 500 feet, and 
virtually impossible to detect at 1000 feet.12 De-confliction issues should also be 
considered. Larger UAVs, such as Predator or Hunter, fly at altitudes common to fixed- 
wing aircraft; smaller UAVs, such as Raven and Dragon Eye, typically fly in rotary-wing 
airspace. 

F. MISSION PRIORITIES 

In 2004 the Joint Chiefs of Staff asked each COCOM and Service to rank the 
importance of 18 missions relative to four general classes of UAS, small, tactical, theater, 
and combat. Their rankings were consolidated into a single chart and are provided in 
Table 4 below. Of note in the chart is the fact that reconnaissance missions are the #1 

Discussion with Ed Fisher concerning his experience with CyberBug operations during daylight 
operations in Thailand. 
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mission priority across all four classes of UAS. Additionally, precision target location 
and designation missions are listed as the number two priority in all but one class of UAS 
(Theater) where it ranks as third. 


Mission 

Small 

Tactical 

Theater 

Combat 

JFC 

Recomiaissaiice 

1 

1 

1 

1 

BA 

Signals Intel 

10 

3 


5 

BA 

Mine Detection CM 

7 

11 

13 

14 

FP 

Pi ecision Taiget Location and 
Designation 

2 

2 

3 

2 

FA 

Battle Management 

4 

10 

4 

7 

C2 

Cheni Bio Reconnaissance 

3 

7 

6 

9 

BA 

Counter Cam Con Deception 

8 

5 

7 

11 

BA 

Electiomc Waifaie 

14 

9 

10 

4 

FP 

Combat SAR 

6 

8 

8 

10 

FA 

Conmiunications Data Relay 

5 

6 

5 

8 

C2 

Information Warfaie 

15 

12 

11 

6 

FA 

Digital Mappmg 

11 

13 

9 

12 

BA 

Littoral Undersea Warfare 

17 

15 

14 

13 

FA 

SOF Team Resupply 

9 

16 

17 

16 

FL 

Weapomzation Strike 

16 

4 

12 

3 

FA 

GPS Psuedolite 

18 

18 

15 

18 

C2 

Covert Sensor Insertion 

12 

14 

16 

15 

BA 

Dec oy Patlifinder 

13 

17 

18 

17 

FA 


Table 4. 2004-COCOM/Service UAV Mission Prioritization 
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III. PROBLEM DEFINITION 


A. INTRODUCTION 

UAS, and in particular, SUAS are new teehnologies with vast potential that is just 
beginning to be diseovered and exploited. Refleetive of teehnologies still under 
development and the limited reeent use of SUAS in operational environments, many 
areas for improvement have been revealed. This ehapter will identify and investigate 
some important ehallenges to be addressed in designing future SUAS FMCSS. 

There is no shortage of ehallenges and problems that remain to be solved in the 
field of UAS. This study eould have narrowly foeused on one partieular problem or 
taken a very broad overarehing view of UAS arehiteeture. In this ehapter we stay 
somewhere in between by addressing three areas in enough detail to guide future SUAS 
FMCSS design, but not so teehnieal as to get lost in the weeds. The three broad areas to 
be examined are: 

• Visual display 

• Interoperability 

• Logisties/Manpower/Training 

• 

B. VISUAL DISPLAY 

In the previous ehapter we diseovered that reeonnaissanee ranked as the most of 
important of 18 different types of missions that UAS either eould or should perform. For 
SUAS, the majority of the data provided in these missions is image data eolleeted from 
eleetro-optieal (EO) eameras. The UAV flies within some distanee of a potential target 
and eolleets visual data that is relayed to operators at the MCS. Human operators are 
tasked with reviewing the visual data eolleeted to determine if there exist targets of 
interest to be aeted upon. The quality of the video displayed direetly affeets the deeisions 
operators make in the field. Several ehallenges assoeiated with visual data from EO 
sensors have been observed. 

• Time to deteet target 

• Target geo-loeation 

• Image stability 
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• Narrow field of view (FOV) 

• Unknown search history 

1. Time to Detect Target 

As a UAV camera points to an area and collects optical information, this data is 
passed to the MCS in near real time (NRT). An operator, therefore, must be able to view 
this data and make decisions based on his or her observation of the incoming visual data. 
As the rate of visual data flow increases, human operators find it harder to identify a 
given target of interest since the target remains in view for smaller amounts of time. In 
one target detection experiment (Itti, Gold, and Koch, 2001), the participants were 
instructed to detect a target in a natural scene photograph; a task similar to UAV search 
task. The average time required for target detection was 2.8 seconds. When UAV 
operations lead to a high rate of video flow, the target may not remain visible on the 
monitor for 2.8 seconds. 

2. Target Geo-location 

Once a target has been detected, the next logical question to be asked is, “where is 
it?” Target location in terms of geographical coordinates is an important capability for 
several military missions. This functionality improves situational awareness (SA) and 
begins to turn raw data into actionable intelligence. At least three missions identified in 
Chapter Two require the UAS to provide geo-located target coordinates. For SUAS 
utilizing EO cameras, identifying the precise location of a target with geographical 
coordinates is not trivial. 

3. Image Stability 

Unstable imagery is a problem with SUAS due to the “bounce” encountered with 
air turbulence. During SUAS experiments at Camp Roberts, California, observers noted 
large oscillations of the video frame displayed at the ground control station (GCS) at a 
frequency of approximately 2-4 oscillations per second. For example, if an object were at 
the top of the monitor image, it would go near, or off, the bottom of the monitor image 
several times per second. 13 


13 Human Systems Integration and Automation Issues in Small Unmanned Air Vehicles; Michael E. 
McCauley, Panagiotis Matsangas; p. 10; October 2004. 
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4. Narrow Field of View (FOV) 

The FOV is the amount of a given seene captured by the camera and is 
completely dependent upon the type of camera being used aboard the UAV. A narrow 
FOV provides a much smaller picture than that normally be seen by a human with his or 
her own eyes and is appropriately described as looking through a soda straw. As the 
FOV increases, operators obtain greater context of the area of interest, but it becomes 
more difficult to identify individual targets due to loss of resolution. Cameras with zoom 
capability allow the mission payload operator (MPO) to change the FOV during mission 
performance. Other cameras may have the capability to pan and tilt allowing operators to 
“point” the camera in any direction within the limits of the camera. This functionality 
gives operators the flexibility of looking in directions not completely determined by the 
UAV flight path, but pan and tilt do not change the size of the FOV. 

5. Unknown Search History 

On most SUAS, the air vehicle operator (AVO) controls the vehicle’s flight path 
while another operator, the MPO, controls and monitors the optical data returned. While 
most missions have automated flight paths following a given set of waypoints to direct 
the UAV, most systems have no automated mechanism to ensure that all areas of interest 
have been observed. Areas within the camera’s FOV can be obstructed by hills, trees and 
buildings that block observation of the areas behind it. 

B. POOR INTEROPERABILITY 

A simple definition was put forth by the Committee on Autonomous Vehicles in 
Support of Naval Operations in their 2005 report to the Navy: Systems are interoperable 
if users can easily and confidently make them work together in reasonable combinations 
that have never been tried before. A counter example of this occurred during set up for 
the field experiment which will be described in Chapter VIII. The experiment called for 
receiving live video data from two Naval Postgraduate School (NPS) designed SUAVs. 
When difficulty was encountered getting one of the vehicles airborne, operators 
attempted to receive data from a different SUAS called Raven. It was quickly discovered 
that the data format used by the Raven was incompatible with the application program 
being used for the experiment and therefore the Raven’s video feed could not be used. 
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Interoperability diffieulties sueh as this will rise with the growing number of 
UAS in use throughout DoD, the civilian community at large and our allies around the 
world. Most of the UAS in development today are being designed as stand alone units. 
Airframes, autopilots, communication, payload processing, and integration with the 
larger command and control structures are being designed on a case by case basis with 
little attention devoted to ensuring they are designed with Joint/Combined 
interoperability requirements in mind. With each different UAS that participates in a 
military operation, it becomes harder to manage and coordinate air combat operations 
because each system will have its own unique software and MCS. 


C. OPERATIONAL SUPPORT 

Operational support is a broad area that can not (and should not) be neglected 
when designing UAS. Operational support considers the requirements for manpower, 
training and logistics throughout the lifecycle of the UAS. In most DoD acquisitions, 
operational support costs easily top those of other categories such as research and 
development, procurement and construction costs. Some estimates place operations and 
support costs between 70 to 80 percent of the total life cycle costs of an acquisition 
system. 14 This challenge can be mitigated upfront by considering these issues during 
UAS design and development. 


14 Article from Defense AT&L Magazine by, Cosmo Calobrisi entitled Meaningful Metrics for Total 
Life Cycle Costs, May-June 2006 issue. 
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IV. TECHNICAL REQUIREMENTS EOR MISSION SUCCESS 


A. INTRODUCTION 

The military, government agencies and commercial companies are spending 
millions of dollars to rigorously explore the best capabilities and/or systems to pursue. A 
good systems engineering approach is needed to help integrate these developments with 
other capabilities and systems that will lead to the best value for the organization and 
ultimately the taxpayers. The current expectation assumes best value will result in 
recommendations that encourage modular designs which will enable plug-and-play 
functionality between components. Additionally, this design should fit well within the 
larger context the Global Information Grid to enable net-centric warfare. 

This chapter will outline the primary missions performed by UAS today and those 
missions that are expected to be performed in the near future. The technical functions 
required to allow these missions to be successful will be discussed and a mission-versus- 
function matrix is presented to show what functions are, or will be, required for specific 
UAS missions. The matrix will form the cornerstone on which to design a FMCSS. 

The primary missions that UAS currently perform are those involving ISR. These 
missions have proven their value to battlefield commanders by providing enhanced 
detection, identification, tracking, and reconnaissance of contacts in an AOI. Depending 
upon the specific system, UAS are capable of searching, collecting, locating, processing, 
updating, and delivering data to decision makers at all levels within the command and 
control structure with the goal of improving situational awareness (SA). SUAS are less 
capable than larger systems due to limited payload capacity and smaller processing 
power, but in general, employment of all UAS share the following objectives: 

a. Maximize sensor coverage 

b. Maximize likelihood of detecting targets of interest 

c. Minimize the time between detection and identification 

d. Minimize uncertainty regarding target location and movement 

e. Minimize time latency between UAS data collection and incorporation 
into SA 

f Maximize collection of priority intelligence requirements 
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UAS are well suited to provide the eapabilities needed to perform ISR missions 
where manned aireraft were onee required. They ean eonduct the so-ealled “dull, dirty 
and dangerous missions” when limited numbers of manned assets are available or when 
eireumstanees present unaeeeptable levels of risk to personnel. For example, UAS are 
finding inereasing roles in the area of border security where it is desirable to limit 
demands on aircrews and more expensive manned aircraft. In hostile environments with 
high threat due to shoulder launched weapons, SUAS are a viable replacement for 
manned helicopters due to their minimal radar cross-section and insignificant heat 
signature. UAS offer an alternative to ground commanders with force protection 
missions by employing a UAS in place of ground combat patrols to provide early 
warning of possible threats. UAS can provide battle damage assessment information that 
would otherwise require manned aircraft or satellite resources. In a maritime 
environment UAS can provide surveillance of vessels being boarded during maritime 
interdiction operations (MIO). 

B. TECHNICAL REQUIREMENTS 

Given the overwhelming priority placed on the STAR mission, this section will 
discuss the technical requirements needed of SUAS in order to effectively accomplish 
STAR missions. 

I. Visual Display 

The visual display is the primary means of receiving information about the 
environment in which the SUAS operates. Key parameters associated with visual display 
are: Time to detect target, image stability, field of view (FOV), target geo-location and 
search history. These parameters will be discussed in the following section. 

Figure 9 is a representation of the time available to the MPO to detect a target 
from the visual scene as a function of altitude and speed. 
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Figure 9. Time of available to detect a target (From; Human Systems Integration and 
Automation Issues in Small Unmanned Air Vehicles; Michael E. McCauley, 
Panagiotis Matsangas; p. 9; October 2004) 


The assumptions underlying the model are; 

• The UAV is flying at constant speed over ground (in [km/hour]) and 
height (in [ft]). Typical air speed for existing SUAVs is in the 80 to 100 
km/hr range. 

• The camera is stabilized. 

• The target is stationary. 

• There are no lags, or other errors. 

• The FOV (30°) of the camera corresponds to a typical value found in 
existing SUAS. 

It can be seen that higher altitudes and slower speeds provide the operator more 
time to detect a target. Only altitudes over 500 feet will provide greater than 2.8 seconds 
to recognize a target. 

a. Time to Detect Target 

In this sense we take into account the time an operator, presumably the 
MPO, takes to identify a possible target from an EO/IR feed originating from a SUAS. 


29 















For STAR missions, until a target is identified, the only intelligence gathered is that no 
target exists within the area of interest. In some cases this is the desired state and no 
further follow on action is required. However, for most missions including strike, EA, or 
CSAR, a target should be identified quickly in order that the next phase of the mission 
may commence. Target identification is required in virtually every UAS mission with the 
exception of the communications relay mission. 

In Chapter III experimental results showed that it took approximately 2.8 
seconds to detect a target in a natural scene photograph. The experiment made 
assumptions that will not always hold true for real world missions such as stabilized 
cameras and stationary and unobstructed targets. It would be interesting to know how 
long it takes, on average, to detect real targets in dynamic environments with varying 
degrees of cover and concealment and with differing camera capabilities. This is an area 
that deserves future research that could guide designers in choosing the optimal sensor 
for a given mission under various operational environments. 

From a command and control (C ) perspective, as target information is 
passed up the chain of command and distributed to friendly units throughout the AOR, 
they are empowered with greater SA. Their enhanced SA gives decision makers a C 
advantage over potential adversaries and leads to faster and better decisions. The time 
required to collect and deliver this information up the chain of command is inversely 
proportional to mission effectiveness. The quicker a target can be identified, the faster 
the next phase of the mission can begin, thereby denying adversaries time they would 
otherwise have to thwart friendly plans. 

Examples of important information that can be collected from SUAS 
equipped with EO/IR sensors includes: 

• Target Eocation (within context of visual display) 

• Target Activity 

• Target Size 

• Target movement 
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b. Target Geo-location 

Target geo-location was identified as a desired capability for three 
missions in Table 6. The effectiveness of STAR, Strike/SEAD, and CSAR all depend, to 
some extent, on the ability of the UAS to geo-locate a target of interest. STAR missions 
should provide target coordinates of enemy units which are then fed to friendly forces 
who utilize this information to carry out a strike mission. Obviously these strike missions 
require very accurate target positioning lest a GPS guided weapon, such as JDAM, could 
miss its intended target resulting in fratricide or collateral damage. 

c. Image Stability 

Image stabilization is a problem with SUAS due to the “bounce” 
encountered with air turbulence. If a zoom lens is used, image stability gets worse when 
zooming on an area or target of interest. Additionally, for cameras equipped with pan 
and/or tilt capability, the MPO will attempt to keep the target within line-of-sight (LOS) 
as the target moves and this usually results in further video display oscillations. 

Ideally, a camera will stay focused on a potential target and remain 
immune to UAV fluctuations. For most SUAS, such as the prolific RQ-11 Raven 
currently used in Iraq and Afghanistan, the sensor payload (EO and IR cameras) is an 
integral part of the airframe and can not be moved. This design contains no form of 
mechanical stability making the returned images completely susceptible to aircraft 
“bounce.” For other SUAS with gimbaled cameras providing pan and tilt capability, 
payload restrictions make it difficult to incorporate more massive inertially stabilized 
systems that are found on larger UAS. A possible solution to the SUAS image stability 
problem involves using software in lieu of hardware. Software algorithms that can be 
integrated within existing SUAS, at the vehicle or GCS level, may be a potential solution 
to reduce the instability of images viewed by operators. 

c. Enhanced Field of View (FOV) 

As mentioned in Chapter II, the FOV is the amount of a given scene 
captured by the camera and is completely dependent upon the type of camera being used 
aboard the UAV. For UAS equipped with cameras having zoom capability, MPOs can 
change the FOV provided. STAR missions orient on the location or movement of the 
reconnaissance objective. Objectives may be stationary such as terrain features or a 
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general loeality, or a mobile enemy force. Often when reconnoitering, the MPO will see 
a potential target and need to “zoom-in” (increase zoom angle) to gain better a look. As 
the operator “zooms-in,” target resolution will increase, but FOV will decrease. This 
smaller FOV removes context that was previously available when using a smaller zoom 
angle. The smaller FOV also makes the visual display appear to be shakier and less 
stable as discussed above. A capability that provides context while providing resolution 
is needed to enhance UAS mission effectiveness. 
d. Search History 

During field experiments at Camp Roberts, a great deal of coordination 
between the AVO and MPO was required to perform missions involving target 
recognition. If the MPO thought he saw something important, he would inform the AVO 
who would take manual control of the UAV in order to get a “better look.” It was 
observed that the operators often had difficulty finding the location of interest and 
determining what areas had previously been searched. A technology that permits instant 
video replay of areas previously surveyed could significantly improve operator 
performance and mission effectiveness. Ideally, this capability should be available to the 
MPO and AVO in real time. Interesting images could be saved locally and sent later to 
other consumers. It may also be possible to use saved imagery to update terrain 
databases or a digital map based common operational picture (COP). 

2. Interoperability 

Besides the technical requirements described above for STAR mission success, it 
is also important that UAS developers to consider how their designs impact other systems 
and how well they can interoperate with these other systems. In 2003 the National 
Defense Industrial Association (NDIA) C4ISR Division together with major UAS 
industry leaders including Boeing, General Atomics Aeronautical Systems, Lockheed 
Martin, Northrop Grumman and Raytheon completed a study that addressed common and 
standard UAS “plug-and-play architectures” that would allow multiple unmanned 
aircraft, sensors, and mission control ground stations to work in a common network. The 
study said it had “not found anyone in the UAV industry who is moving toward 
architecture commonality.’’^^ It called for DoD to enforce compliance with common 

UAV Programs Need Common Standards, Says Industry Study, Sandra I. Erwin, National Defense 
Magazine, October 2003. 
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standards and warned that while a universal arehiteeture is aehievable, it must be 
managed properly. 

In a July 2004 interview with National Defense Magazine, Dyke Weatherington, 
the deputy of the UAV planning task foree at the Office of the Secretary of Defense, 
acknowledged that “...in the next two or three years, you’ll see some air vehicle 
interfaces...and the focus should be on defining a standard air vehicle interface for small 
UAVs because of the ease of receiving data from them, the large number of potential 
users and the airspace issues that could arise from hordes of organic squad-level 
UAVs.”i^ He noted that different classes (i.e. sizes) of UAVs would have similar, but 
not identical interfaces. SUAS, for example, would not likely carry weapons and 
therefore not be in need of a weapons interface. Additionally, he envisioned that 
interfaces for the SUAS would be designed to work on control stations such as laptops 
and PDAs likely to be found at the small unit level. This prediction is slowly becoming a 
reality as many of the new SUAS being developed utilize laptop computers or handheld 
PDA-like devices to control the UAV and payload. 

At the international level, UAS are currently produced by 14 of the 26 member 
states of NATO. This fact further underscores the importance of conforming to standards 
in order to optimize battlefield effectiveness in ever increasing multi-national operations. 
Recognizing the importance of interoperability, NATO has written Standard Agreement 
(STANAG) 4856 to address standard interfaces of UAS control systems. In its second 
edition, STANAG 4586 was conceptualized to promote interoperability between UAS to 
include one or more GCS, UAVs and their payloads, and the Command, Control, 
Communication, Computer and Intelligence (C4I) network, particularly in joint 
operational settings, In an effort to align itself with this standard. The U.S. Navy has 
been developing the Tactical Control System (TCS) in order to provide a single product 
for the control of UAVs from the different manufacturers. The Army has developed its 
own common GCS called the One System station for use with Shadow, Hunter and 
Predator UAS which will also be compliant with STANAG 4856. The Marine Corps and 

Pentagon Setting Guidelines For Aircraft Interoperability, Michael Peck, National Defense 
Magazine, July 2004. 

Human Performance considerations in the Development of Interoperability Standards for UAV 
Interfaces, M.L. Cummings, J.T. Platts, A. Sulmistras, 2006. 
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Air Force are conducting bi-monthly meetings with their Army-Navy counterparts to 
ensure their UAS procurements are interoperable with those of the Army and Navy and 
therefore eompliant with the NATO standard. 

3. Operational Support 
a. Manpower 

Currently, UAS erews consist of operators based on the functional areas 
they control such as mission payload operator (MPO), air vehiele operator (AVO), 
communieations offieer, weapons release authority (for Unmanned Combat Aerial 
Vehicles (UCAVs)), and a mission eommander. Applieations to reduee these functional 
manpower positions into fewer positions are just beginning to be considered. Compared 
to manned aireraft, UAS have the potential to significantly reduce these eosts. Savings 
will be achieved when functional manpower positions are reduced or more UAVs ean be 
adequately controlled by the same positions. 

To realize these savings, UAS must beeome more autonomous, that is, 
eapable of performing funetions in flight that are eurrently performed by human operators 
at the MCS. A key ehallenge being addressed is how the operator interacts with the 
aireraft under normal operations and when an emergency develops. Interfaces must be 
designed to allow the operator to understand what is going on at a glance so that adequate 
time is available to handle both normal and emergency situations as they develop. 

The Army currently has four different types of UAS to conduet 
operations: the RQ-IL I-Gnat whieh was reeently upgraded with a turboeharged engine to 
extend its operating altitude to 30,500 feet, the RQ-5/MQ-5 Hunter and RQ-7 Shadow 
whieh are eonsidered tactical UAS (TUAS); and the RQ-11 Raven, a SUAS. To get a 
quick look at the manpower required to operate these individual systems, a “best case” 
“human-to-UAV” ratio is ealeulated by assuming all UAVs are airborne at one time. 

• The Hunter has 48 military and 5 eontraetor personnel to operate six 
UAVs for a “human-to-UAV” ratio of 8.8:1. 

• The Shadow UAS consists of four UAVs with 22 military and 2 contractor 
personnel giving it a ratio of 6:1. 

• The I-Gnat organization is made up entirely of contractor personnel 
(normally 10) and eontains three UAVs for a ratio of 3.3:1. 
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• Lastly, the Raven SUAS has the best “human-to-UAV” ratio with only 
two operators and three UAVs for a ratio of only 0.7:1. 

Current UAS operations however, normally do not involve all aircraft in 

the system to be flying simultaneously. Despite having the capability to operate multiple 

UAVs per system simultaneously, the limited number of communication frequencies 

available often restricts the number to one UAV airborne at a time. Assuming only one 

UAV is flying at any given time yields “worst case” ratios of 53:1, 24:1, 10:1 and 2:1 for 

Hunter, Shadow, I-Gnat and Raven respectively. 

b. Training 

Most DoD UAS operating today employ contractors to conduct the 
majority of their UAS training requirements. This can be attributed to the fast pace at 
which UAS are being developed and underscores the lack of interoperability among the 
wide variety of UAS in the field. Until unmanned aviation becomes standardized within 
the services, the use of civilian contracted trainers will need to continue. For those UAS 
that require unique and costly maintenance, the use of contractors may prove a better 
option than training military personnel. The status of training for the individual U.S. 
military services is provided in the 2005 Roadmap and reproduced in Table 5 below. 
With the exception of the Army's Hunter and Shadow training programs, each UAS has a 
dedicated training program with the students in these courses ranging from experienced 
rated officers as pilots to recent enlistees as airframe maintainers. 
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System/Coui’se 

Senice 

Location 

Duration Throughput 

Fit 

Houi's 

Staff 

Global Hawk 

An Force 

Beale AFB. CA 




10 

Pilot 



26 weeks 


32 


Sensor Operator 



12 weeks 

18 >T 

48 


Maintenance 



5 weeks 




Hiiiiter 

Anuy 

Ft Hiuichuca. AZ 




300+* 

Internal Pilot 



24 weeks 

40 \T 

21.5 


External Pilot 



16 weeks 

4 yr 

30 


Mamtenance 



10 weeks 

20 \T 



Tecluucian 



11 weeks 

20 \T 



Pioneer 

Na\y 

OLE Choctaw. FL 




37**+** 

Mission Commander 



3 weeks 

17\t 

10 


External Pilot 



17 weeks 

24 \T 



Internal Pilot Payload 
Operator 



14 weeks 

40\t 

56 


Mechanical Mamtenance 



7 weeks 

18 \T 



Teclmical Mamtenance 



9 Weeks 

24\t 



Predator 

An Force 

Indian Springs AFAF. N\' 




22 

Pilot 



13 weeks 

48\t 

38 


Sensor Operator 



14 weeks 

48 \T 

37.5 


Mamtenance 



4 weeks 




Shadow 

Anuy 

Ft Hiuichuca, AZ 




300*^ 

Operator 



24 weeks 

240 AT 

14.5 


Mamtenance 



8 weeks 

40 \T 



Teclmician 



9 weeks 




’"Number of graduates is total fi om the seven Global Hawk Maintenance coiu'ses. Diu ation is average length of the 
seven coiu'ses. 

*’"Total staff supporting Himter and Sliadow instmction at tlie US. Aniiy UAS Traming Center. 

’"’"♦Consists of some 80 horns flymg subscale RC models plus 22 hoiu's fl\ing tlie Pioneer. 

*♦♦♦ Nmuber of giaduates is total from the fi\'e Piedator Mamtenance coiuses. Duration is average length of the 
five coiuses. 

♦♦♦♦♦Total staff supporting Pioneer traming at OLE Choctaw. 


Table 5. Status of Training (From: UAS Roadmap, 2005) 


c. Identified Training Challenges 

The 2005 Roadmap has identified four distinct training issues and goals to 

be pursued:!^ 

• Although a spiral acquisition approach is favored for most UAS programs, 
it imposes an unrecognized burden for UAS trainers: always being one or 
more steps out of phase with the capabilities being incrementally fielded. 
This requires additional training (i.e., cost) at the unit level after the 
student completes initial training. 

• Current ground stations are not designed to be dual capable for use in both 
controlling actual missions and conducting simulated flights for training. 

Unmanned Aircraft Systems Roadmap 2005-2030, 4 August 2005, Office of the Secretary of 
Defense, pp. 63-64. 
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This drives added product support costs for dedicated simulators and task 
trainers by requiring more numerous and higher fidelity simulators and 
trainers. 

• The current and projected OPTEMPO associated with the Global War On 
Terrorism (GWOT) does not allow systems to be taken off-line for 
extended periods of time in order to implement hardware and software 
improvements and to train operators on the new capabilities. 

• Most UAS maintenance training lacks dedicated maintenance trainers as 
well as digital technical orders and manuals with embedded refresher 
training. This results in factory representatives having to be fielded at most 
UAS operating sites and to deploy to war zones to compensate for 
inadequate training. 


E. FUNCTIONS-VS- MISSIONS 

This chapter is concluded with a table showing UAS missions versus the 
functions or capabilities required to successfully accomplish the mission. The table has 
an additional column that identifies the particular UAS subsystem associated with the 
given function and will be elaborated on in Chapter VII. For now, the intent of Table 6 is 
to provide designers a list of the functional capabilities needed to effectively perform the 
most likely missions that current and future UAS will conduct. 
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MISSIONS 

SUBSYSTEM 

DESIRED FUNCTIONS/CAPABILITY 

STAR 

EA 

STRIKE 

SEAD/ 

DEAD 

NETWORK NODE/ 

COMMUNICATIONS 

RELAY 

CSAR 

Vehicle 

Propulsion 

X 

X 

X 

X 

X 

Vehicle 

Electrical Power 

X 

X 

X 

X 

X 

Vehicle 

Vehicle Systems Monitor 

X 

X 

X 

X 

X 

Vehicle 

Vehicle Control And Stablization 

X 

X 

X 

X 

X 

Vehicle 

Autopilot / Homing 

X 

X 

X 

X 

X 


Sensor/Weapon 

Sensor Measurement And Control 

X 

X 

X 


X 

Sensor/Weapon 

Weapon Measurement And Control 



X 










MCS 

Fly-The-Sensor 

X 

X 

X 

X 

X 

MCS 

Communications Link Monitor 

X 

X 

X 

X 

X 

MCS 

Operator / Flight Control 

X 

X 

X 

X 

X 

MCS 

Flight Pattern Execution 

X 

X 

X 

X 

X 

MCS 

De-Confliction 

X 

X 

X 

X 

X 

MCS 

Battlefield SA Update 

X 

X 

X 

X 

X 

MCS 

Tactical Mission Planning 

X 

X 

X 

X 

X 

MCS 

Multi-UAV Coordination 

X 

X 

X 

X 

X 

MCS 

Sensor Commands 

X 

X 

X 


X 

MCS 

Flight And Airspace Planning 

X 


X 

X 

X 

MCS 

Known Search History 

X 

X 

X 


X 

MCS 

Commander'S Intent 

X 

X 

X 


X 

MCS 

Rehearsal 

X 

X 

X 


X 

MCS 

Image Stabilization 

X 


X 


X 

MCS 

Target Geo-Location 

X 


X 


X 

MCS 

Multiple Target Tracking 

X 

X 



X 

MCS 

After Action Report (AAR) 


X 

X 


X 

MCS 

Target Assignment 

X 

X 

X 



MCS 

Strategic Mission Planning 

X 



X 


MCS 

Real Time Video Target Tracking 

X 


X 



MCS 

ROE 



X 



Communication 

Flight Control Link UAV to GCS 

X 

X 

X 

X 

X 

Communication 

Sensor Control Link UAV to GCS 

X 

X 

X 

X 

X 

Communication 

Link Between GCS and MCS 

X 

X 

X 

X 

X 

Communication 

Link Between MCS and Other Consumers 

X 

X 

X 

X 

X 

Support 

UAS Storage 

X 

X 

X 

X 

X 

Support 

Deployment / Delivery 

X 

X 

X 

X 

X 

Support 

Maintenance 

X 

X 

X 

X 

X 

Support 

Logistics Re-Supply 

X 

X 

X 

X 

X 


Table 6. Functions vs. Missions 
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V. GENERIC UAS SYSTEM DESIGN 


A. INTRODUCTION 

A large number of UAS are being developed and mueh of this development is 
driven by economic considerations. Governments, and particularly their militaries, 
understand the cost savings they can realize by implementing UAS systems into areas 
traditionally held by piloted aircraft. The American Institute of Aeronautics and 
Astronautics (AIAA) lists hundreds of UAS either under development or in production 
worldwide as of July 2005. Design of UAS should seek to identify and standardize the 
functions required to accomplish UAS missions and make the components as 
interoperable and potentially plug and play compatible as possible. This standardization 
will lead to more affordable systems without sacrificing capability. 

In this chapter the basic concept and design of a generic UAS is discussed. For 
practical purposes, there is little difference between this generic model and that of a 
SUAS and therefore the model applies equally to both. 

B. BASIC CONCEPT OF AN UAS 



Figure 10. UAS Concept (From; Fundamental “UAV” Concepts and Technological Issues, 
Uwe K. Krogmann, North Atlantic Treaty Organisation, Research And 
Technology Organisation, RTO-EN-025 AC/323(SCI-109)TP/41) 
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Figure 10 on the previous page illustrates the basie eoneept of an UAS. Although 
the aireraft is unmanned, the system is not. Human operation is eentral to the flexible 
eontrol of every UAS. If properly equipped, the operator ean exploit information not 
only from onboard UAV sensors, but also information from offboard sensors sueh as 
other UAS or ground units or even information from databases inside and outside the 
AOR. The eontrol station eould be loeated anywhere, i.e., on the ground, at sea, or in the 
air or spaee. The important goal of modem UAS is to put an operator’s brain in the 
eoekpit while leaving his/her body on the ground. With this human in the loop (HIL) 
operation, the UAS eontains the rational, judgmental, and moral qualities of a person and 
enables the system to be operated over a diverse and dynamie set of eonditions and 
missions. 


C. UAS FUNCTIONAL SUBSYSTEMS 

The UAS, and indeed all systems, eonsist of subsystems that are assembled 
together in sueh a way that they are eapable of performing functions that the individual 
subsystems would be unable to accomplish alone. Subsystems are individual and distinct 
units within the system capable of performing their own unique functions. These 
subsystems consist of components that may be located close together or far apart. 
Regardless of their location, the designer must integrate these subsystems and 
components into a complete system, the UAS, that enables an aircraft with its onboard 
sensors and offboard MCS to perform a wide range of missions without the physical 
presence of a pilot in the aircraft. 

In broad terms, a typical UAS can be broken down into five major functional 
subsystems as shown in Figure 11. These subsystems provide all the functional 
capabilities for the UAS that were listed in Table 6. Some of the functions are performed 
within multiple subsystems and, therefore, no perfect one-to-one correlation between 
functions and subsystems exists. The table, however, provides a point of reference to 
enable understanding of where in a typical UAS these functions reside. This section 
provides a brief description of the subsystems and the functions they provide. 
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Support 

Subsystem 



1. Vehicle Subsystem 

The vehicle subsystem consists of the aircraft and the components related to its 
management and control. Major components within the vehicle subsystem could include 
the engine, alternator (generator), landing/takeoff gear, autopilot, avionics, etc. The 
vehicle subsystem provides the following functionality listed in Table 7; 


Propulsion 

Vehicle Control and Stablization 

Electrical Power 

Auto-reflex / Stabilization 

Vehicle Systems Monitor 

Autopilot / Homing 


Table 7. Vehicle Subsystem Functionality 


2. Mission Control Station Subsystem 

The mission control station (MCS) is a generic term used to describe the people 
and components involved with mission planning and flight control. The MCS often 
consists of two parts, one located close to UAV operations which is referred to as the 
ground control station (GCS), and another station that handles the higher level mission 
plaiming and battlespace awareness issues such as a theater level command and control 
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headquarters or a smaller taetieal operations center (TOC). For simplicity, we refer to 
either component as the MCS. Most of the functional capability of an UAS resides in the 
MCS subsystem. Table 6 lists 21 unique functions performed within this subsystem. 
Conceptually, the MCS subsystem contains the “brains” of every mission and provides 
for the command and control (C ). The MCS subsystem could be physically located on 
the ground, at sea, or in the air. It could also consist of more than one station to increase 
reliability, for example, in a network-centric organization that has multiple MCS 
networked together. If one station is destroyed or otherwise loses communications with 
the vehicle, the other MCS would take over where the first left off. Often, some MCS 
function are delegated to a “lower level” MCS such as a local GCS. The GCS mentioned 
earlier, is usually responsible for “flying” the UAV and sending data back to a higher 
level MCS that is responsible for transforming the raw data received into actionable 
intelligence (information). 


Operator / Flight Control 

Tactical Mission Planning 

Waypoint Command Generation 

Real Time Video Target Tracking 

Rehearsal 

Flight And Airspace Planning 

Image Stabilization 

Seach Pattern Generation 

After Action Report 

Flight Pattern Execution 

Target Id And Location 

Communications Link Monitor 

Local De-Confiiction 

Close To Real-Time Tracking 

Strategic Mission Planning 

Multi-UAV Coordination 

Battlefield SA Update 

Commander's Intent 

Sensor Commands 

Fly-The-Sensor 

Target Assignment 


Table 8. Mission Control Station Subsystem Functionality 

3. SensorAVeapon Subsystem 

The sensor/weapon subsystem contains the components that sense or effect the 

environment. This subsystem can be broken into other distinct subsystems as the 

complexity increases. While somewhat simple when described at high level, the sensor 

or weapon components themselves can be very complex and constitute a significant 

fraction of the total UAS cost. The majority of SUAS are unarmed, and predominantly 

perform STAR missions; therefore, the weapon subsystem is not applicable to SUAS 

operation. Because the sensor(s) is attached to the air vehicle, operators normally think 

first in terms of flying the UAV to the AOI. Once the UAV reachs the AOI, efforts are 

shifted to positioning or aiming the sensor at a potential target. With the target within the 

sensor’s FOV, the product—video data for example, can be transmitted back to the MCS 
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and distributed. Common sensors aboard a SUAV inelude EO/IR eameras and GPS. 
Functionality of the sensor / weapon subsystem include: 


Sensor Measurement And Control 
Weapon Measurement And Control 

Table 9. Sensor/Weapon Subsystem Functionality 

5. Communication Subsystem 

The communications subsystem consists of components located throughout the 
UAS and supports communication at any level within the bigger system. For example, 
part of the communication subsystem provides the video link between a camera and the 
MPO and consists of the radio transmitter aboard the UAV and the receiver located at the 
GCS. Another part of the communication subsystem may pass data between a platoon or 
squad level GCS located near the forward line of troops (FFOT) and a battalion tactical 
operation center (TOC). 

Without the communication subsystem it would be impossible to create the virtual 
pilot by putting his or her brain in the cockpit as discussed earlier. For SUAS, 
communication is accomplished through an RF line of site (FOS) link between the 
aircraft and operators. Farger UAS may have multiple links including satellites that 
significantly extend the distance between operator and UAV. Problems with the 
communication subsystem such as loss of link, will usually significantly impact mission 
performance. If the communication link is lost (worst case) for example, most missions 
will have to be aborted since the majority of UAS lack the autonomy required to 
effectively execute important missions without a human-in-the-loop (HIF). Fatency is 
another common communication link problem that may prevent remote operators from 
controlling the UAV in real time. The latency issue requires local operators within FOS 
to perform take-off and landing maneuvers that can not tolerate the time delays 
associated with long communication links such as those involving satellites. 
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Communication 

Flight Control Link UAV to GCS 

Communication 

Sensor Control Link UAV to GCS 

Communication 

Link Between GCS and MCS 

Communication 

Link Between MCS and Other Consumers 


Table 10. Communication Subsystem Functionality 

5. Support Subsystem 

As UAS operations continue to grow, they become more dependent upon robust 
service and support organizations that can remain responsive to their increasing needs. 
Planning, managing, and executing supply support and maintenance involves 
synchronized coordination at many levels to ensure seamless integration. Logistics and 
maintenance should never be overlooked when designing a UAS as most of the total life 
cycle costs are traceable to these functions. Some of the key functions associated with 
the support subsystem include; 


Uas Storage 

Maintenance 

Deployment / Delivery 

Logistics Re-Supply 


Table 11. Support Subsystem Functionality 


D. UAS FUNCTIONAL LAYER MODEL 

Another descriptive way to illustrate an UAS is with the aid of a functional layer 
model as shown in Figure 12. There is no direct one-to-one correspondence between a 
particular subsystem and a particular functional layer, nor is it necessary to explicitly 
show each subsystem in the functional layer model. The important concept to convey 
concerns the direction of data flows and the reaction times associated with the different 
functional layers within the UAS. Other systems engineering considerations are shown 
on the right side of the figure. These design characteristics represent the tradeoffs that 
UAS designers must consider when developing UAS. 
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Design Characteristic Trends 
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The layers implemented in the functional design model show the division between 
the low level fast reaction time components required to implement flight control, 
housekeeping, and sensor maintenance functions traditionally executed by a pilot or 
navigator, from the higher level functions required to execute mission objectives. Lower 
level functions are treated as services to higher-level functions and low-level 
implementation details should be hidden in order to reduce cognitive load on human 

operators. For example, if a surveillance mission is initiated, the MCS may require a 
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scan of a road segment and reeeive the output of a sensor with suffieient resolution and 
dwell time to allow for vehiele identification. The exaet flight path required to point the 
sensor, provide eommunication eonneetivity, and/or monitor fuel eonsumption should be 
provided as a serviee to the MCS by lower level funetions either within the UAV or GCS. 
These serviees should not be an additional task(s) performed by the MCS. 

E. FLY THE SENSOR 

The generie design description presented in this chapter views the UAS as a 
means to put human eyes on a target of interest without the need for those eyes to be in 
physieal danger i.e., the virtual pilot idea. The design focus centers on the UAV which 
must be flown into an area of interest in order to get the appropriate sensors fixed on an 
expeeted target. Onee this is aeeomplished and sensor data is suoeessfully transmitted 
back to human operators, the “real mission” ean begin. By “real mission” we mean the 
decision making aspects of missions such as interpreting video from a STAR mission to 
gain intelligence on an adversary or deeiding whether or not to launeh a missile in a 
Strike mission. Deeision makers are not partieularly interested in how a vehicle gets to 
the AOI. Tasks sueh as “driving” the aireraft or monitoring a video sereen to diseern 
useful information from noise is a distraetion and impediment from aceomplishing the 
more important mission at hand. 

The title of this section, “Fly the Sensor,” implies a shift of foeus eoneerning UAS 
operation. Instead of eoneentrating on flying a UAV with the pilot safely on the ground, 
we suggest shifting the mission emphasis to that of flying an appropriate sensor (or 
effeetor in the ease of a eombat UAV (UCAV)). The benefit of designing an UAS with a 
foeus on flying the sensor viee the aireraft, is that more human attention is plaeed on 
mission eritieal information as opposed to the lesser, but still important, aspeets of flying 
the vehiele. 

Notiee in the design eharaeteristies of Figure 12 that algorithm complexity 
inereases as data rises to higher levels in the funetional model. Algorithm eomplexity is 
equivalent to the eognitive load or proeessing “horsepower” that is required of the UAS 
to perform a given task. The algorithm eomplexity is proportional to task eomplexity 
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and, fortunately, also proportional to reaction time. As tasks become more complex, a 
human would require more thinking, or a computer would require more computing, in 
order to effectively deal with the task. Performing the higher level functions, such as 
analyzing video, have naturally been delegated to human operators since human operators 
excel over computers when it comes to image understanding. However, at the lower 
functional levels in the model, the tasks and algorithm complexity become simpler and 
the reaction time required gets compressed. At this point machines become better than 
humans, in terms of speed and accuracy, and these tasks are better relegated to computers 
and software. 
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VI. TECHNOLOGY GAPS 


A. INTRODUCTION 

While UAS performance has grown by leaps and bounds over the last 20 years, 
there remain a virtually unlimited number of areas where improvements can be made. 
This is particularly true for SUAS since they have been in operation for a shorter period 
of time. It would be impractical (and probably impossible) to address all the technology 
gaps being confronted by developers of SUAS in one volume. This chapter will address 
several technology gaps associated with the display of visual data returned from SUAV 
EO sensors (cameras). 

B. TARGET GEO-LOCATION 

The ability to rapidly detect and identity potential targets, both fixed and mobile, 
from UAS sensor feeds is a critical function in several mission areas. Simple geo¬ 
location techniques are sufficient for general orientation but are not suitable for providing 
accurate sub-meter targeting coordinates. Historically, military target planners relied on 
comparisons between hard copy reference photos and tactical images derived from 
battlefield aerial reconnaissance photo sources. The advent of digital photography and 
near real-time (NRT) transmission of imagery has shortened the time needed to observe 
an AOI, but the problem of NRT geo-location remain s a significant problem particularly 
for SUAS. To illustrate a fundamental problem associated with target geo-location, 
consider a target located on flat terrain as shown in Figure 13. Assuming the platform 
sensor’s coordinates are provided by GPS, and the camera attitude is known from 
onboard sensors, the angle to the target (pointing angle) can be readily determined. With 
this information the target coordinates can be approximated quickly by simple 
trigonometric calculation. Unfortunately, most terrain is not flat and large inaccuracies 
will result even if the platform location and pointing angle is known. 
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Figure 13. Target On Flat Terrain (From; www.cardiolix.com; accessed 28 July 2006) 


Figure 14 illustrates the error that can result if the terrain is not flat. This error is 
amplified when the pointing angle increases, for example, when the UAV flies at lower 
altitude (Figure 15 next page). 



Figure 14. Target On Uneven Terrain (From: www.cardiofix.com; accessed 28 July 2006) 
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Figure 15. Error At Lower Altitude (From; www.cardiofix.com; accessed 28 July 2006) 

Three key parameters are required to calculate the coordinates of a potential 
target: 1. Known sensor location at time image was captured; 2. Sensor pointing angle 
and 3. Sufficiently detailed 3D terrain model. Additionally, accurate time stamps are 
needed when the image is captured to synchronize the data. Even when these parameters 
are known, enormous amounts of computation is required to geo-locate the target of 
interest. NRT target geo-location can not currently be accomplished aboard the UAV due 
to weight and power constraints, and therefore must be accomplished at the GCS or 
MCS. The next chapter will describe a unique technology development being pursued at 
Naval Postgraduate School as a possible new technology solution to the target geo¬ 
location problem. 


C. IMAGE STABILITY 

Video signals transmitted to the MCS from UAVs are often unstable. As noted in 
Chapter 111, video displayed from a SUAV on the GCS monitor at Camp Roberts was 
observed to “bounce” on and off the screen approximately two to four times per second. 
These oscillations were the result of the SUAV being buffeted by the wind due to its 
small size and mass. For cameras equipped with zoom capability, the image stability 
problem is worsened when the sensor’s FOV is decreased by zooming in on an area of 
interest. 
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Without steady video, image sharpness deelines and it beeomes harder for an 
operator to discern finer details. An operator tasked with watching video can remain 
more alert since eye strain and overall fatigue is reduced when viewing stable video. The 
possibility also exists to lower the quantity of data (bits) transmitted because steady video 
will compress better than shaky video. Less data means a smaller storage device is 
required to capture the same video, or more recording time will result with the same 
storage device. 

At the time of this writing, only one of the 12 different small or mini UAS listed 
in the 2005 UAS Roadmap came equipped with some form of video stabilization. The 
Boeing Corporation’s ScanEagle SUAS utilized an inertially stabilized gimbaled camera 
as standard equipment to provide video stabilization. During a recent technology 
symposium at the Naval Postgraduate School, the author observed a recording of 
ScanEagle video while operating in wind gusts exceeding 30 mph winds and noted few 
oscillations in the displayed video. However, inertial stabilization comes with the 
unwanted costs of added weight and increased power requirements. Alternative image 
processing technologies using new software could be applied to the video stream at the 
GCS. Though several electronic image stabilization systems are available, their general 
use and effectiveness to SUAS has been limited. To enhance video image stability, more 
robust image processing or ultra light weight inertial gimbaled camera systems, or a 
combination of these techniques, needs to be developed. 

D. SIMULTANEOUS WHAT AND WHERE VIDEO PRESENTATION 

Eor SUAS, EO cameras are the predominant means for providing video data to 
the MCS, usually on a fixed monitor. Since the pilot is not seated in the vehicle, 
vestibular feedback received from changes in vehicle attitude i.e., rotations, will not be 
felt. Other sensory cues such as audio or proprioceptive information from the muscles in 
the neck and eyes which aids pilots with viewing direction are also missing. Without 
these kinesthetic sensory cues, limitations on the operator’s situational awareness exist. 
These shortcomings can result in degraded operator performance such as losing track of a 
target, difficulties assessing camera, platform, and target motions, confusion in flying 
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direction of the platform, confusion on viewing direction of the camera, disorientation, 
and degraded situational awareness. 

The current state of UAS automation requires HIL operation and key decisions 
will often have to be made by human operators. As long as humans remain central to 
UAS operation, there will always be human factors that must be considered in the system 
design. A recent study was performed that revealed eighteen human factors issues unique 
to UAS that deserve future research .20 Five of the factors are related to the perceptual 
and cognitive aspects of the pilot interface and research is recommended to study the 
affects of providing an “augmented reality” or “synthetic vision.” 

A separate study by Van Erp and Van Breda has identified at least eight 
shortcomings concerning remote camera control of unmanned vehicles. One of these 
shortcomings addressed in the Problem Definition chapter concerns the field of view 
(FOV). As the FOV gets smaller, the operator may observe better resolution but this 
comes at the expense of lost context in the area of operation. In other words, the operator 
may know more about what he or she is seeing (due to better resolution), but will know 
less about where they are looking to do decreased FOV. The capability to simultaneously 
display what the sensor is pointing at while providing context about where the sensor is 
located is a technology gap existing in most SUAS. 

E. BANDWIDTH LIMITATIONS 

While technically not the same as data throughput, bandwidth (BW) is the term 
generally used to describe the data throughput of a communications system. As the BW 
increases, so does the data throughput. In broad terms, BW limitations can be created by 
anything that hampers or minimizes that the transmission of data from UAV to the MCS. 
The communications subsystem discussed earlier is responsible for providing the critical 
link between the vehicle sensors and the operators located at the MCS. The current 
paradigm for SUAS operation, and even for their larger counterparts, is to relay nearly all 

Van Erp, J.B.F. & Breda, L. van (1999). Human factors issues and advanced interface design in 
maritime Unmanned Aerial Vehicles: a project overview 1995-1998. TNO-TM 1999 A004. Soesterberg, 
The Netherlands: TNO-HFRl. 

29 Human Factors Implications of UAVs in the National Airspace, Jason S. McCarley & Christopher 
D. Wickens, April 2005. 


53 



sensor data back to the MCS for processing. The amount of raw data collected by 
onboard sensors easily exceeds the onboard processing power of SUAS. To convert this 
data to useful intelligence, the communications subsystem must transmit this data to the 
MCS for processing. When doing so, they frequently overwhelm the available 
communications BW. This section considers several limitations associated with the BW 
of SUAS. 

1. Power Limitations 

The communications subsystem is constrained by the power output of the onboard 
transmitter and the gain of the transmitting antenna. The output power must be sufficient 
to overcome any losses that could be encountered while transmitting data from the UAV 
to the MCS. Most SUAS employ omni-directional antennas that radiate radio waves 
equally in all directions similar to the way the sun radiates light into space. Since the 
signal is uniform strength in all directions there is no need to worry about directing the 
antenna, but this method is not very power efficient. Radio frequency power decreases 
with distance squared. For example, if the MCS is to receive a signal of a given strength 
from a UAV which moves twice as far away, the onboard transmitter would need to 
produce four times the power. 

To improve performance, the UAS could radiate at higher power or the GCS 
could employ a directional antenna with a tracking capability to maximize the power 
received from the UAV. The latter technique is employed by the NFS SUAS. By 
following the UAV flight path with a high gain directional antenna, the GCS is able to 
receive a greater amount of the signal being transmitted from the SUAV. The former 
technique could also be used to improve signal reception from longer distances. Of 
course the disadvantages of this method are seen as increased size and weight of the 
UAV transmitter. Most SUAS, and all hand launched systems have payload capacities 
well under 10 pounds^T Additionally, most hand-launched UAV uses batteries to 
provide for all power requirements including propulsion. To get more power, the UAV 
would have to carry a larger battery which means more weight, which means less 


21 The 2005 UAS Roadmap lists eight out of nine SUAS with payloads less than 10 pounds. 
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endurance. These tradeoffs must be considered to optimize the performance for any 
particular UAS mission. 

2. Vulnerability of Active Transmitter 

When an omni-directional antenna radiates, no mechanism is in place to direct the 
signal energy, hence anyone with a suitable receiver can detect its transmission. Given 
the large amounts of data collected, particularly from imagery collection associated with 
STAR missions, the transmitter often appears to be continuously transmitting. This 
situation makes the transmitting UAV more vulnerable to detection and attack since an 
adversary will have more time to locate its position. To mitigate this vulnerability, 
transmitted data can be compressed to reduce the required BW. The downside of this 
technique is that compression algorithms intentionally discard information that could be 
valuable. Until onboard processing power increases enough to minimize transmission 
requirements, compression algorithms will remain one of the better solutions to fill this 
gap. 

3. Line-of-Sight Limit 

High altitude UAS can maintain high bandwidth communication links over great 
distances with other UAVs or the MCS due to their large line-of-sight (LOS) distance. 
SUAS normally fly at altitudes of less than 1000 feet and have maximum RF LOS of 
approximately 70 km (Figure 7 Radio LOS vs. Altitude). This coverage assumes ideal 
conditions with no obstructions between UAV and MCS and high enough transmission 
power to complete the radio link. For low altitude SUAS flying in urban areas with 
buildings or in areas with hills, a LOS data link can easily become obstructed. 
Additionally, discussion with SUAV operators revealed that more typical operating 
ranges are between 3 and 10 nautical miles due to transmission power limitations. 

The terrain encountered during field experiments at Camp Roberts is 
characterized by many low rolling hills throughout the airspace which often obstruct the 
LOS between GCS and UAV. To overcome this limitation, multiple UAVs can be flown 
to act as relays or as part of a mesh network. One of the problems with this solution is 
the added expense in flying multiple UAVs. Also, when utilizing a mesh network 
topology, throughput is limited due to bottlenecks on the last node making connection 
with the GCS. 
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F. SENSOR DATA MANAGEMENT 

UAS sensors have the capaeity to generate huge amounts of data. Large UAS are 
eapable of produeing ~10^^ bits per seeond (bps) of information .22 if only a fraetion of 
this data is transmitted it would still easily exeeed the data link BW eapaeity of modern 
UAS. Most SUAS are equipped with multiple aireraft per system. In most oases, STAR 
missions are still predominantly performed utilizing only one airborne UAV due to 
frequenoy oonfliots with other UAVs. However, this paradigm is shifting as experienoe 
with flying multiple UAVs inoreases and the teohnology to support it advanoes. The raw 
data returned from UAV sensors is of little value if the information oannot be synthesized 
and understood within a time span that permits military deoision-makers to aot. Three 
sensor data management gaps have been identified in SUAS are addressed next. 

1. Instant video playback 

As disoussed in Chapter IV, the video reoeived and displayed on the GCS monitor 
oan arrive rapidly making it diffioult for an operator to deteet features or targets of 
interest. The lower the altitude of the sensor, the quieker the data will pass on the sereen 
for any given UAV speed. At typieal speeds of SUAVs (80 to 100 km/hr), the altitude 
must be greater than approximately 500 feet to deteet a target within a 2.8 seeond 
window. Usually when a target is deteeted the operators will want to see it again right 
away to verify what they think they saw. Without a video playbaek eapability, the sensor 
would need to be repositioned in order to again find the target. For moving targets, a 
video playbaek eapability becomes even more important. Current SUAS operations 
dictate flying the UAV to a point where the MPO can direct the sensor to get a fix on a 
potential target within the AOI. Obviously, this becomes significantly more challenging 
for moving targets and requires a good deal of coordination between the AVO and MPO. 
A better paradigm would prescribe “flying the sensor” as opposed to flying the UAV and 
will be discussed in the following chapter. 

2. Multi-view Retrieval 

When a sensor passes over anything of interest, the operator observes that area 
from the angle at which the sensor is pointing. In addition to having the record and 
playback capability mentioned above, the operator should have the ability to retrieve 
22 Autonomous Vehicles in Support of Naval Operations, The National Academies Press, 2005, p. 

208 . 
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images from other sensors taken at different times and from other perspeetives. 
Historieal data of the AOI would have to be stored and made easily available to the MCS 
operator in a timely manner else its value is diminished. To minimize the possibility of 
information overload on man and maehine, the operator could be asked to provide his or 
her AOR on the user interface. The data management application would ensure that only 
data within this relevant area is retrieved. Additionally, all stored historical data would 
necessarily be geo-referenced to ensure consistency with the current view with which it is 
being compared. 

3. Image Difference and Change Detection 

The need to rapidly detect and accurately geo-locate a target’s location was 
identified above as a technology gap that impacts several UAS missions. Traditional 
image registration techniques tend to fail in the presence of complications such as cloud 
occultation, elevation distortions, and illumination variations and automated registration 
of oblique low angle views has remained difficult^s. A technology solution is being 
developed at Naval Postgraduate School that utilizes software algorithms and an image 
differencing technique to address this problem. The approach used employs two low cost 
PC based workstations and a software package called Perspective View Nascent 
Technologies (PVNT). One computer executes a program that captures images at one 
second intervals and synchronizes them with received telemetry messages. The other 
computer running the PVNT software generates telemetry controlled calculated 
perspective views from received GPS and camera angle coordinates at one second 
intervals. The combined system manages the sensor data and provides target position 
estimates with 1-2 meter accuracy. 


23 A Description of Image Targeting with PVNT Target Location and Sensor Fusion through 
Calculated and Measured Image Differencing; Wolfgang Baer and Todd Ross Campbell; 2003 
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VII. TECHNOLOGY SOLUTION DEVELOPMENTS 


A. INTRODUCTION 

According to some industry experts, the Joint Strike Fighter will be the last major 
DoD manned aireraft aequisition. This means that UAS will have to fill the ever 
widening gap that develops as manned aireraft deeline in number. It is eritieal, therefore, 
that the U.S. exploit new teehnology for UAS to the maximum extent possible in order to 
maintain its eurrent edge and direet the industry in ways advantageous to national 
seeurity. Additionally, the nature of modern asymmetrie warfare is dietating a 
fundamental paradigm shift from platform to network eentrie warfare in order to 
effeetively and affordably fight the wars of the 2U‘ eentury. UAS have demonstrated 
their ability to work in the net-eentrie environment and warfighters are inereasingly 
requesting their eapabilities. 

In this ehapter, we deseribe two different ideas or eoneepts eoneerning the 
operation of UAS. The first idea represents the prevailing eoneept today. It follows 
naturally from the way we have historieally operated manned and unmanned aireraft with 
the pilot and aireraft at the eenter of the mission. The eurrent state of teehnology 
supports this eoneept and there is little wonder why it prevails. The seeond idea proposes 
an alternative view that plaees emphasis on the mission as opposed to the pilot and 
aireraft. Instead of thinking in terms of flying the aireraft, we suggest the eoneept of 
“flying the sensor.” The eurrent state of teehnology has not eaught up to this idea, but it 
is only a matter of time before it does and new UAS system designs should move in this 
direetion. 

For SUAS, the teehnology gaps identified in Chapter VI will be best solved 
utilizing a software, viee a hardware approaeh. In this ehapter, the reasons that support 
the pursuit of software over hardware teehnology solutions are presented. Teehnology 
developments applieable to the identified shortfalls are being pursued at NFS. While the 
potential solutions are foeused on advaneing the mission support for SUAS, mueh of this 
teehnology has equal applieability to any UAS. It is our hope that this researeh will 
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enhance the design of SUAS flight and mission control support systems (FMCSS) and 
stimulate new ideas and research in the field of UAS. 


B. DESIGN PHILOSOPHY 

Every good system design process starts with an overarching idea or goal that 
guides the architect and other system designers. The common goal or “big picture” idea 
helps designers form a picture in their mind of what the system is suppose to accomplish 
or behave. The mental picture envisioned has little direct affect on detailed design 
decisions, but instead provides a framework in which to place the detailed design 
decisions that will be made at a later stage. Concerning UAS design, one major design 
philosophy prevails. This approach is described next followed by an alternative approach 
that will become more appropriate as the services become more net-centric. It is 
important to note that regardless of the design philosophy chosen, the ultimate goal 
remains to design a better system that enables warfighters to accomplish their mission in 
the most effective manner possible with limited resources. 

I. “Brain in the Cockpit” 

The current paradigm in UAS design centers on the concept of keeping one UAV 
operator’s head (brain) in the cockpit while leaving his or her body on the ground. 
System designers want to, ideally, replicate the cognitive powers of a human (perhaps 
even super-human) in the cockpit with some type of computer processing. Where 
shortcomings remain, the system is augmented by a remote human operator through a 
data link to the UAV. 

To the extent that we can put an operators head in the cockpit while leaving his or 
her body on the ground, determines how closely the UAS can perform when compared to 
its manned counterpart. Similar to a person in a flight simulator or playing a video game 
(virtual pilot), the pilot on the ground, with the aid of information processors, can control 
the aircraft as if he or she was sitting in the cockpit. They operate the aircraft under all 
possible conditions that the aircraft can fly and make decisions when uncertainty and 
confusion exist. For example, when bearing arms, the virtual pilot will operate under the 
rules of engagement (ROE) and make tough decisions about when and when not to use 
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deadly force. With the HIL, the full range of human judgment, intellectual capability and 
moral character can be brought to bear in any mission. 

2. “Fly the Sensor” 

An alternate design philosophy takes emphasis off the pilot and aircraft and shifts 
it to information. We have labeled this concept “fly the sensor” to emphasize the 
importance of a sensor in collecting mission critical information regardless of platform 
type. This is an important distinction to make now that war is being waged in the 
Information Age. We don’t care so much about where or what platform the information 
comes from, as we do about its qualities such as accuracy and timeliness. To enable this 
warfighting philosophy, the DoD has invested resources to build a Global Information 
Grid (GIG) that will allow the military to conduct Network Centric Warfare (NCW). 
NCW can be defined as: 

an information superiority-enabled concept of operations that generates 
increased combat power by networking sensors, decision makers, and 
shooters to achieve shared awareness, increased speed of command, 
higher tempo of operations, greater lethality, increased survivability, and a 
degree of self-synchronization^^. 

The “fly the sensor” design philosophy is consistent with the concept envisioned in NCW 
and places more human attention on mission critical information as opposed to tasks 
involving UAV flight. 


C. HARDWARE VERSUS SOFTWARE SOLUTIONS 

People living today are witnessing a technological explosion similar to, but more 
rapid, than the technological growth experienced during the industrial revolution of the 
19* and early 20* centuries. During that period the economy was dominated by 
machinery and manufacturing. Today the developed nations of the world have entered a 
new economic era, sometimes referred to as the digital revolution, being led by 
advancements in computer hardware and software. The time between significant 
technological developments is rapidly decreasing and we have reached the knee of the 
curve in an evolution of technology. Author and inventor Ray Kurzweil has described 

24 Network Centric Warfare: Developing & Leveraging Information Superiority, David Alberts, John 
Garstka, Frederick Stein. CCRP Publications series, February 2000. p. 2. 
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this phenomenon as the “Law of Accelerating Returns”25 and predicts no limit to the 
exponential growth of technology. 

In today’s information age, technology advances can be broadly classified into 
two major categories; hardware and software. While hardware is a general term which 
includes any type of machine, tool or other physical components, the hardware making 
the most impact in the information age, is computer hardware. Computer hardware was 
developed before any software was produced. Indeed computer hardware had to come 
first, for without computer hardware it is impossible to run any software. The computing 
field is only about 60 years old beginning on the tail end of the industrial revolution, but 
its growth is without precedent in the world of engineering. The most significant 
hardware development to occur in the history of computing is the integrated circuit. 
Starting with the invention of the transistor in 1947, which replaced vacuum tubes, 
integrated circuits with millions of transistors on one substrate were developed and have 
now become ubiquitous. 

Gordon Moore, co-founder of Intel, famously noted in a 1965 article of 
Electronics Magazine that the complexity (interpreted as the number of transistors) of 



Figure 16. Gordon Moore 

integrated circuits doubles roughly every year. In a follow-on article in 1975 he adjusted 
this estimate to every two years to account for chip complexity.^® This trend has held 

The Age of Spiritual Maehines; Ray Kurzweil; 1999. 

Teehnology@Intel Magazine entitled: From Moore's Law to Intel Innovation—Predietion to 
Reality; Radhakrishna Hiremane; April 2005. 
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remarkably true (Figure 17) and is believed by many, that it will last for at least another 
10 to 20 years before a fundamental physical limit is reached. 

Moore's Law 
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Figure 17. Moore’s Law (From; website: 
http;//en.wikipedia.org/wiki/Image;Moore_Law_diagram_%282004%29.jpg 

accessed July 28, 2006) 


Software is a distinct technology that consists of digital data or programs residing 
inside a computer’s hardware (memory). Software can’t be seen or felt and takes up no 
physical space within the hardware. Computer hardware and software technologies must 
work together to both produce value. As the computer hardware industry races ahead 
providing more powerful capabilities, and better-faster-cheaper computing and 
communication devices, a software gap has developed that prevents us from exploiting 
all the capability and value that these hardware devices promise. So which technology 
provides more “bang for the buck’’ and which technology needs more focused attention 
and resources when designing future SUAS flight and mission control support systems 
(FMCSS)? 
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It is hard to definitively or quantitatively answer this question, however, the 
research conducted while writing this thesis points in the direction of software, 
particularly image processing and data handling applications that can improve the 
effectiveness of STAR missions. The computer hardware improvements realized, for 
example, as a result of Moore’s Law, will continue unabated regardless of the direction 
taken by the designers of SUAS. Software developments, on the other hand, that 
specifically add value to SUAS will require focused efforts on the part of SUAS 
designers. New software developments offer the possibility to significantly improve the 
functionality of SUAS by shifting more work off humans and accomplishing it in the 
software. 

The same argument advocating software over hardware improvements can be 
applied to airframe hardware as well. Airframe hardware improvements, such as 
inertially stabilized gimbaled cameras, will usually result in added weight to the UAV 
platform. Adding weight lowers endurance for the same fuel load and increases total 
costs. Figure 18 shows the empty weight and cost data for several DoD UAVs. Today 
the average cost for the UAVs listed is $1500 per pound of empty weight. When the 
payload is included the cost jumps to approximately $8000 per pound of payload weight 


System 

Aircraft 
Cost, FY04S* 

Aircraft 
Weight, lb* 

Payload 
Capacity, lb 

System Cost, 
FY04S 

Number 

Acft/Svstem 


S28.5K 

3.5 

1 

S130.3K 

3 

RQ-7A Shadow 

S0.39M 

216 

60 

S12.7M 

4 


S0.65M 

307 

75 

S17.2M 

5 

RQ-8B Fire 

Scout 

S4.1M 

1.765 

600 

S21.9M 

4 

RQ-5A Himtei- 

S1.2M 

1,170 

200 

S26.5M 

8 


S2.7M 

1.680 

450** 

S24.7M 

4 

MQ-9A Predator 

S5.2M 

3.050 

750** 

S45.1M 

4 

RQ-4 (Block 10) 
Global Hawk 

S19.0M 

9.200 

1.950 

S57.7M 

1 

RQ-4 (Block 20) 
Global Hawk 

S26.5M 

15.400 

3.000 

S62.2M 

1 


♦Aucraft costs are miiiiis sensor costs, and auciaft weights aie luuuis fliel and payload capacities 
♦* Internal pavload weight capaciw only 


Figure 18. UAS And UAV Costs And Weights (From; UAS Roadmap, 2005) 


(Figure 19). Note, however, for the only SUAV listed, the Dragon Eye, the cost per 
pound is significantly greater in both categories—approximately $30,000 per pound. 
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Any airframe hardware technology improvements would have to be made with very light 
weight materials to keep costs from skyrocketing. To improve SUAS capability with 
hardware, the most cost effective solutions will likely be achieved if they are applied to 
the ground or mission control stations. 

Payload Weight (■) 



Figure 19. UAV Capability Metric: Weight V. Cost (From: UAS Roadmap, 2005) 

In this chapter software solutions are presented as a way to fill the technology 
gaps identified earlier. The hope is that these potential solutions may lead to significant 
improvements in the design of SUAS FMCSS. 
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D. GEO-LOCATION 

A vision-based target traeking system has been developed and is being refined at 
NFS. The system has the potential to signifieantly improve the proeess of identifying 
target eoordinates obtained in STAR missions performed by SUAS (or any UAS). The 
system was utilized in a field experiment diseussed in the next ehapter and is deseribed in 
the paragraphs that follow. 

Video eaptured by an EO eamera aboard a SUAV is transmitted on a 2.4 GHz link 
to the GCS. The GCS uses off-the-shelf PereeptiVU image proeessing software^^ whieh 
allows an operator to seleet and look on a target displayed on the GCS monitor. The 
PereeptiVU software provides eoordinates of the oentroid of the target seleoted by the 
operator. These eoordinates are then employed by oontrol and filtering algorithms 
implemented on the NFS ground station.28 Flight tests oonduoted by NPS have 
demonstrated the ability to provide 20-3 Om aoouraoy in target geo-looation obtained 
within 15-20 seoonds of traeking. 

The system oan operate within a mesh network that allows data sharing between 
all nodes eonneeted to the system. In addition to the real-time traeking and estimation 
algorithms employed by the GCS, the UAVs telemetry and onboard images are sent to a 
Perspeetive View Naseent Teehnologies (PVNT) workstation that enables more preeise 
geo-loeation measurements to be obtained. The PVNT is a general software paekage 
addressing the generation and utilization of metrieally aeeurate one-meter terrain 
databases for measurement, analysis, and visualization of live/virtual taetieal battlefield 
situations. The system implements a unique image registration teehnique that allows near 
real time (NRT) view projeetions with elevations ineluded. Other teehniques tend to 
eoneentrate on the alignment of aetual images taken from various angles and tend to fail 
in the presenee of eomplieations sueh as eloud oeeultation, elevation distortions, and 
illumination variations. PVNT performs registration between a measured image and an 
image ealeulated from a terrain database as opposed to registering two or more images 
direetly. Using this approaeh, the viewpoint oan be modified and a new image generated 
27 PereeptiVU Inc, www.Perceptive.com 

2^ Ick H. Whang , Vladimir N. Dobrokhodov , Isaac I. Kaminer, and Kevin D. Jones, “On Vision- 
Based Target Tracking and Range Estimation for Small UAVs," AIAA 2005-6401, AIAA Guidance, 
Navigation, and Control Conference and Exhibit, 15 - 18 August 2005, San Francisco, CA. 


66 



that includes elevation distortions, surfaee oeeultation, and to some extent atmospherie 
effects. This procedure enables comparison of images whieh have to a large extent been 
eorreeted for these parameters. 

The PVNT system consists of two standard PC computers. One exeeutes an 
interfaee program that eaptures and displays six seeonds of images eaeh at one seeond 
intervals and synehronizes the images with telemetry messages. The seeond eomputer 
running the PVNT software generates telemetry eontrolled calculated perspective views 
from received GPS and eamera angle eoordinates at one seeond intervals. The ealeulated 
and measured views are then registered and differeneed to highlight the target.29 When 
the ealeulated and measured view are elose enough to perform target loeation, the PVNT 
operator then performs a final target loeation by choking on the loeation in the ealeulated 
image where the target would appear if it were in the database. The advantage of this 
vision-based target traoking approaoh is that the acouracies of target loeation is 
determined almost exolusively by the aocuracy of the database and does not require 
preoision gimbals or aoourate UAV loeation data. The oombined system provides target 
position estimates with l-2m aoouraoy and has been suocessfully demonstrated in several 
field experiments conducted by NPS at Camp Roberts.30 Figure 20 shows the FOV from 
two sensors and the ealeulated perspective views generated by PVNT. 


39 W. Baer, T. Campbell, “Target Loeation and Sensor Fusion through Caleulated and Measured 
Image Differeneing,” Signal Processing, Sensor Fusion, and Target Recognition XII, Ivan Kadar, Editor, 
Proeeedings of SPIE Vol 5096(2003) p 169. 

30 Vision Based Target Traeking and Network Control for Mini UAVs; I. Kaminer, V. Dobrokhodov, 
K. Jones and W. Baer. 
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Figure 20. PVNT FOV and Calculated Images 


E. IMAGE STABILITY 

Image stability can be improved utilizing hardware or software techniques. 
Hardware solutions are categorized as active or passive. Passive stabilization techniques 
are purely mechanical and rely on the "balanced beam" phenomena. The 'beam' will 
resist base motion from affecting the camera positioned at the end of it because of the 
inherent inertia of the balanced beam. Active hardware systems are ones that utilize DC 
power, sensors, electronics and motors attached to gimbal rings to correct base motion 
from affecting the camera.31 For UAS, hardware solutions are acceptable only on larger 
platforms where weight and power limitations do not restrict their use. 

For SUAS with payloads one or two orders of magnitude smaller than larger 
UAS, ultra light weight inertially stabilized gimbaled camera systems or more robust 
image processing techniques, or a combination of both, offer the only practical solution. 
There are several companies that currently market software products that claim to 
improve video stability. 


31 Nettman Systems International website: http://www.eamerasystems.eom/gyrostabilization.htm, 
aeeessed 4 September 2006. 
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1. Tactical Image Processing Software (TIPS) 

TIPS made by Brandes Associates Incorporated is a portable system designed for 
small and mini-UAV missions. It employs enhancement algorithms that penetrate fog, 
haze and mirage artifacts commonly found in the raw input video stream. The video 
image stream data can be stabilized in 4-dimensions (X and Y, rotation, scaling and 
zooming) to counter vibration encountered on SUAV payloads. It accepts most video 
input formats providing day and night video image enhancement. TIPS performs as a 
passthru system with a delay of no more than 2 frames. 

The TIPS system was operationally tested with PVNT. The application 
automatically cropped and readjusted the image position to the center of the monitor with 
every frame capture. One observer reported a fuzzy picture containing artifacts in the 
displayed image and questions whether the advertised preprocessing capability to provide 
contrast enhancement and image sharpening was actually achieved. Company website is 
accessible at: http://www.brandes-assoc.com/technology_insertion%20v2.HTML 

2. SteadyEye^’^ 

Made by DynaPel Systems Incorporated, SteadyEye is an application that 
integrates with analog Color, B/W, IR or thermal cameras. The system advertises the 
ability to correct shake in the horizontal and vertical direction as well as shake from 
rotation and zoom. The system was tested with the NPS SUAV with only marginal 
results. One operator suggested that it would produce acceptable results if used in 
conjunction with inertial stabilization. Company website is accessible at: 
http://www.dynapel.com/index.shtml 

3. VICE 

Designed by Sarnoff® Corporation, VICE (Video Imagery Capability 
Enhancement) claims a host of real time video processing capabilities on a standard PC. 
The software provides electronic stabilization to remove camera shake and real time 
mosaicing to create panoramic views of a scene as the camera pans. It has an automatic 
moving target indicator (MTI) that can graphically show or alert operators to a moving 
target in the image view. The software can display 3D video for up to eight video feeds 
on reference imagery or maps and merge other forms of data with the video. 
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The VICE system was reeently tested for compatibility with the NFS PVNT 
software in field experiments conducted at Camp Roberts. The experiment successfully 
demonstrated the ability to capture and transfer stabilized imagery to PVNT. The 
successful integration will lead to future experiments to see if images stabilized through 
the mosaic process would improve SUAS STAR mission performance. Company 
website accessible at: http://www.samoff.com/ 

4. Future Possible Solutions 

In general, the problem with image stabilization occurs when multiple images are 
superimposed on one another. Most software applications employ algorithms that take 
averages of pixel contrast to reconstmct images. While this may produce a more stable 
image, its value is degraded because the image tends to become “fuzzy.” Potential 
solutions to this problem may lie in innovative new algorithms that do more than simply 
take pixel averages. Two areas are suggested for research that could possibly minimize 
or solve this problem: 1. Radar mono-pulse scanning and 2. saccadic eye movement. 

Radar mono-pulse scanning is used in fire-control tracking radars and employs 
one radar pulse to obtain a target’s range, bearing and elevation angle. Mono-pulse 
tracking radars achieve higher target resolution by comparing the target location in 
multiple pulses, hence it is not the pulse width, but the envelope between multiple pulses 
that determines angular resolution. This radar technique can be accomplished 
electronically requiring no mechanical action and is not subject to errors due to rapid 
fluctuation of the returned echo signal amplitude as the target moves (scintillation errors). 

Saccadic eye movements are very rapid simultaneous movements in both eyes in 
the same direction. These movements occur naturally in human vision so that the point 
of interest will be centered on the fovea, the high resolution central part of the retina. 
Human vision has evolved to make these adjustments as fast as possible and saccades are 
the fastest movement of the external part of the human body. Even when fixated on a 
stationary target, micro-saccades are required to refresh the image cast on the retina 
because receptors in the retina are only responsive to changes in luminance. These eye 
movements occur naturally and are not perceived as image instability in the brain. 
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Both mono-pulsing radar and saccadic eye movements are examples by whieh 
image clarity and resolution are improved with multiple measurements. Not all image 
stabilization techniques employ visual methods, and therefore stabilized images are often 
less clear, although stable. Further study is needed to determine how these teehniques 
eould be applied to improve image resolution. It is hoped that algorithms may be created 
based on the physies of mono-pulse scanning or saccadic eye movements that reduce or 
eliminate the distortions observed in image stabilized video. 

F. WHAT-WHERE DISPLAY 

Chapter VI identified a gap in the ability to simultaneously display what a sensor 
is pointing at while providing eontext about where the sensor is located. The PVNT 
system offers a possible software solution to this problem. By mapping the aetual 
measured image eollected from an EO sensor to the video cones displayed in Figure 18, 
an operator would be able to see both what the sensor is looking at, as well as context on 
where the sensor is located. This idea was tested in the field experiment described in the 
next chapter. It should also be pointed out that the PVNT system can project the returned 
images on other map displays besides the “god’s eye” view shown in Figure 20. For 
example, the images eould be mapped onto a eartographic map as shown in Figure 21. 
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Figure 21. PVNT Perspective Views on Cartographic Map 


The ability to project multiple images on one display is a step in the direction 
toward lowering the human to UAV ratio discussed earlier. This simultaneous what- 
where display could be combined with “fly-the-sensor” technology allowing UAV flight 
to be controlled directly through the manipulation of sensor projections potentially 
lowering the cognitive load placed on UAS operators. 


G. SENSOR DATA MANAGEMENT 

This section addresses two of the three technology gaps related to sensor data 
management identified in Chapter VI. These technology solutions were tested in a recent 
field experiment and will be discussed in Chapter Vlll. 

1. Instant Video Playback 

The PVNT system provides a means to capture, display, record and playback 
video frames transmitted from EO sensors. The system has been designed to allow an 
operator to playback video frames recently displayed. Ideally the system could retrieve 
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video captured at any time during the mission, however, practical limitations such as disk 
space limit the amount of playback allowed. This playback capability may enhance 
mission success by precluding the necessity for a UAV to fly over an area previously 
viewed. The results of this video playback capability are discussed in Chapter VIII. 

2. Image Difference and Change Detection 

In addition to providing highly accurate geo-located target coordinates as 
described above, PVNT can use its excellent and accurate data presentation to identify 
changes in terrain. Terrain changes can be produced naturally due to weather, 
earthquakes, or volcanic activity; or by people constructing buildings or simply placing 
objects in different positions. Detecting terrain changes with SUAS can be quicker and 
safer than sending people or manned aircraft or over hostile areas. Using SUAS is also a 
better alternative than satellite reconnaissance because satellites are predictable allowing 
an adversary to deceive or hide important information. 

H. PRODUCT-LINE ARCHITECTURE 

Table 6 in Chapter IV identified important functions required for various UAS 
missions and listed where these functions are performed within the five subsystems of a 
generic UAS. These subsystems were laid out in the functional layer model of Figure 12 
to illustrate where these subsystems are located within a typical UAS. The functional 
divisions are separated in time by approximately two orders of magnitude each. The 
values indicated on the figure are representative of the current technology level that 
SUAS operate. Ideally, we would like everything to happen as efficiently as possible, 
exactly when needed and consuming as few resources as possible. However, the other 
design characteristics listed on the figure must also be considered and tradeoffs will have 
to be made when designing SUAS (or any system). 

To achieve the desired mission success, the functions listed in Table 6 must be 
performed by entities or components i.e., humans, hardware, or software or some 
combination. These components must be connected together in an architecture or 
framework that permits information exchange between them. Besides the 
communication subsystem represented by the clouds in Figure 12, data is passed between 

components through application interfaces consisting of: 
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• Transport protocols i.e., TCP/IP, UDP, etc. 

• Web addresses i.e., URLs 

• Message data definitions i.e.. Cursor on Target (CoT) 

Most SUAS contain a variety of similar applieation requirements that ean be 
designed with mostly generic software. To maximize the interoperability of the software 
components that may come from a variety of different vendors, formal interface 
definitions are required. To achieve the desired result, a product-line architeeture is 
recommended as the best approaeh [2, 3]. A product-line arehitecture defines a set of 
reusable generic components and specifies how data and control should flow among them 
to solve application problems32. A well designed architecture conducive to “plug and 
play” operation will encourage developers to ereate interoperable eomponents of 
inereasing quality and eapability. 

The funetional model discussed above is a first cut attempt to define the 
functional components and framework in which a generic SUAS FMCSS may be 
designed. The next step requires the development of formal data specifieations for use in 
a produet-line arehiteeture. A rapid benefit of this approaeh would be the reduetion of 
ad-hoc face-to-face meetings of individuals that are neeessary to work out data 
management problems currently experieneed in the NPS field experiments. 


G. BANDWIDTH 

While some of the missions identified in this thesis may not require huge amounts 
of bandwidth, the primary reeonnaissance missions as well as combat search and rescue 
(CSAR) and some eommunication relay missions depending on the data relayed, all 
require significant amounts of bandwidth to transmit imagery data. Teehnologies that 
enable more proeessing to be accomplished onboard the UAV only slightly help to 
mitigate this problem. As the vehiele becomes more autonomous, less data is needed 
between GCS and UAV. Unfortunately, the eommand and control data is only a small 
fraction of the total amount of information that must be transmitted. As the military 


22 Model-based Communication Networks and VIRT: Filtering Information by Value to Improve 
Collaborative Decision-Making; Dr. Rick Flayes-Roth, Naval Postgraduate School, April 2005. 
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strives to achieve the objective of net-centricity, issues with bandwidth limitations are 
likely to continue in the foreseeable future and will continue to receive focused attention. 

One possible solution involves using a mesh network as opposed to individual 
direct links. In a mesh network, multiple nodes e.g., UAVs, can be used to transmit data 
much like routers in a ground based network. By increasing the number of nodes the 
number of possible paths available to transmit data increases. Theoretically, with more 
pathways available, there exists a larger “pipe” i.e., greater bandwidth, in which to 
transmit data. 

The mesh technique has recently been tested in the NFS field experiments with 
unmanned ground and aerial vehicles. The technology tested is made by ITT and uses a 
proprietary protocol similar to the IEEE 802.16 protocol. So far the technology has 
produced less than desirable results. When multiple users tried to access data from 
different individual UAVs, a new data stream from the UAV platform was generated over 
the mesh network to the receiving clients. As a result, when more than one user wanted 
to receive video, the network load capacity was exceeded and performance became 
difficult. 

To solve this problem, digital video from the UAV’s was transmitted to a single 
Pelco receiver where it was reconverted to analog video, sent via a cable to the TOC and 
reconverted to digital video where it could be locally distributed on higher bandwidth 
lines in the TOC. 
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VIII. FMCSS FIELD EXPERIMENT 


A. INTRODUCTION 

Every academic quarter a series of experiments coordinated by NFS and Special 
Operations Command (SOCOM) is conducted in cooperation with a number of other 
government organizations, industry and universities. The bulk of the experiments take 
place at Camp Roberts located approximately 120 miles south of NFS. Much of the 
research is focused on unmanned air and ground vehicle operations as well as the 
network supporting these operations. Two experiments are described in this chapter; one 
took place in early June of 2006, the other during the third week of August 2006. 
Officially the experiments were designated TNT-06-3 and TNT-06-4 respectively. 



Figure 22. TNT UAVs 

B. TNT EXPERIMENT 06-3 


The Flight and Mission Control Support System’s (FMCSS) overarching 

objective was to support flight coordination, feature identification, and target location for 

multiple SUAVs. Specifically, experiment 06-3 objectives were to: 

• Synchronized Image Playback: Test image capture, storage, and 
playback function to support image navigation and feature identification 
and target location. 
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• Multiple UAV Sensor Projection Display: Test multiple SUAS sensor 
on map projection display to enhance the operator’s ability to manage 
multiple data streams at once. 

• Interface Testing; Define and test general SUAS interfaces for video and 
telemetry to provide mission support for alternative UAV platforms. 

The discussion that follows will cover the salient portions of first two 

objectives.33 

1. General Setup 

Figure 23 illustrates the layout of SUAS FMCSS that was setup in the Camp 
Roberts Tactical Operations Center (TOC). PC interface machines, IF-1 and IF-2 in the 
figure, can receive video and GPS telemetry from two UAVs. IF-1 and IF-2 capture and 
format data for transmission to the middle PVNT PC. The PVNT machine performs 
image geo-referencing, target coordinate determination and provides image display 
locally or to larger situational awareness (SA) screens within the TOC. 



Figure 23. SUAS FMCSS 


33 Full technical details and thorough description of the experiment can be found in the final report 
entitled: UAV Flight and Precision Targeting Mission Control Experiment 20 Report for TNT-06-3; Dr. 
Baer, June 16, 2006. 


78 











































































































2. Detailed Schematic 

Figure 24 shows the eonnectivity, equipment and software eonfiguration for 
experiment TNT-06-3. Telemetry paths are shown as solid arrows while video data is 
depicted with wide arrows. Two video streams are monitored and selected frames are 
transferred to the PVNT machine for local display and also for projection onto larger wall 
screens within the TOC for wider review. 

Special interfaces were established to both NFS SUAVs using Pelco transmitters. 
One transmitter on each SUAV broadcasted video over a mesh network to the GCS 
where it was then placed on the TOC network where it became accessible through 
browser based Pelco plug-ins. SUAV telemetry was transmitted to a second Pelco 
receiver which provided telemetry directly to the MCS interface machines through Rs- 
232 connections. 
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Figure 24. Detailed Schematic 


3. Synchronized Image Playback 

This part of the experiment was designed to address the technology gap identified 
in Chapter VI concerning sensor data management. The previous chapter suggested a 
potential solution to this problem could be developed that would allow an operator to 
essentially “rewind” previous video data returned in order to perform a more detailed 
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analysis. To test the ability to display, record and playback a series of frames, code was 
written by NPS professor Dr. Wolfgang Baer and installed onto the interface machines 
depicted above. Our hope is that a low cost software solution can be developed that will 
improve an operators effectiveness while performing surveillance type missions, such as 
STAR. A brief description of this software is provided below^^. 

The software component, called Video Time Trail Playback, provides a means to 
display, record and playback a series of frames, called the Window. A trail consisting of 
several (9 max) sequential frames is displayed on separate windows in the interface 
machine. Figure 25 below shows a typical screen snapshot showing the display. 


Viewer 

Screen 



8th 

window 

Video 

canture 


Instant 

playback 

slider 


Control 

Dialog 


Figure 25. CRP Interface Program Screen 


Incoming video frames from a SUAV sensor are displayed in the large viewer 
screen shown on the left side of Figure 21. An operator uses this view to look for and 
detect features of interest. The nine trailing frames provide a display of the last 9 captured 
frames. The capture rate is selectable but 1 second is typical. 

In earlier experiments it was found that 9 seconds was inadequate for an operator 
to perform useful analysis on the incoming frames. The Video Time Trail Playback 

A detailed description is provided by Dr. Baer entitled: VideoTimeTrailAndPlaybackFunction.doc; 
April 20, 2006. 
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software component was designed to allow an operator to select a buffer size (limited 
only by disk storage capacity) that would store video frames that could be played back 
for comparison and analysis. A disk buffer and slider control was added, set to a default 
value of 100 frames, to allow instant image playback. Frame telemetry is synchronized 
and recorded with each frame so that its geographic location can be determined. The trail 
and image manipulation features are expected to provide the operator context to 
individual frames and facilitate both target identification and location. The intent was to 
evaluate technology trade-offs in global system functions, which enhance mission 
success, and see how much the Video Time Trail Playback component helps. 

The experiment succeeded at recording and providing instant image playback 
during several flights. However, orientation data was never received and the limited 
position data was delayed between 5 and 10 seconds making geo-referenced playback 
impossible. A direct data interface to the NPS SUAV designed to provide on-time 
position and attitude telemetry was never achieved due to wind and communication 
difficulties. These difficulties were overcome during a repeat experiment in the TNT-06 
trials described below. 

4. Multiple UAV Sensor Projection Display 

This part of the experiment was also designed to address a sensor data 
management gap as well as the simultaneous display of what and where video 
information. In this case the problem concerns providing a video display that contains 
both what and where information simultaneously while conducting STAR missions. 
Typically two operators at the GCS are involved to conduct operations involving one 
UAV; an air vehicle operator (AVO), and a mission payload operator (MPO). The AVO 
will observe a situational analysis (SA) display that provides context concerning the 
location of the UAV. The MPO will focus his or her attention on a separate display 
containing the real time returned video. Mission effectiveness is affected by how well 
both operators coordinate with each other to “drive” the UAV and analyze the returned 
reconnaissance data. 

In this experiment, the solution developed employs a software algorithm written 

by Dr. Baer that projects video imagery from multiple UAVs (two in this case) onto a 

single large map or perspective SA display. The goal is to provide a low cost software 
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solution that can be implemented in a MCS that will improve operator effeetiveness 
while performing STAR missions. A sueeessful solution will help a single operator 
understand, manage and eontrol sensor data from multiple UAV’s simultaneously. At the 
time of the experiment, bandwidth limitations prevented real time video from being 
displayed so only eaptured imagery was transferred. The intent of this experiment was to 
determine if the proposed solution eould be implemented. If so, new display teehnology 
development that fuses multiple real time data streams on one overview would be 
justified. In the future, this display eould be used to expand the “fly the sensor” eoneept 
to “fly the swarm of sensors.” 

Imagery from two UAVs, the Rmax and NPS SUAV, was eaptured and 
transferred to the PVNT display. Figure 26 on the next page shows the two eaptured 
images projeeted onto a map display. Due to teehnieal diffieulties with the NPS SUAV, 
no live image was projeeted. Instead the white eontent shown is due to data from the 
PELCO transmitter that oeeurs when no video data is available. 

The experiment suceessfully demonstrated that two images eould be sent to the 
PVNT workstation and projeeted onto the map display at 1.5 fps for eaeh image. 
However, the geo-loeation aeeuraey was poor due to laek of and, in most oases, 
unavailability of timely position and oamera orientation data for the UAVs. 

Another observation was made oonoerning the image viewed on the soreen. We 
notioed that soreen resolution oollapses near the apex of the viewing oone. As the image 
is squeezed into a smaller area on the soreen, less pixels are available to display it and 
olarity is lost. While the oone map projeotion is a good idea, it oan not replaoe the 
additional view window at this time. 
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Rmax Captured image 



Calculated image lOM high 



Figure 26. Rmax and NFS UAV Image Projections on Map Display 
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C. TNT EXPERIMENT 06-4 


Similar to experiment TNT 06-3, the FMCSS overarching objective for TNT 06-4 
was to support flight coordination, feature identification, and target location for multiple 
SUAVs. TNT 06-4 had three objectives: 

• “Fly-the-Sensor:” Test the ability of the FMCSS to control the sensor of 
the NFS SUAV in order to facilitate feature and target tracking 

• Image Stabilization: Integrate the Samoff VICE system with the FMCSS 
in order to evaluate the ability of the mosaic capability to supply 
electronically stabilized imagery to down stream search, feature 
identification, and target tracking systems. 

• Message Standardization: Test message format and integrate telemetry 
in order to receive data and provide mission support services for all 
UAVs. 

The discussion that follows will cover the salient portions of first two 
objectives'^. 

I. General Setup and Schematic 

The general setup for TNT 06-4 is similar to TNT 06-3 with the exception that 
only one interface machine is required. Figure 27 illustrates the FMCSS schematic with 
one CR-IF machine. 


Full technical details and thorough description of the experiment can be found in the final report 
entitled: TNT-06-4 Individual Experiment AAR Executive Summary; Dr. Baer, September, 2006. 
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Figure 27. TNT 03-4 FMCSS Schematic Diagram 
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2. Fly the Sensor 

Figure 4 shows video returned from the NFS SUAV while tracking a dark colored 
HMMWV. Prior to this a white SUV acted as the moving target but could not be seen on 
the white road background. A UDP interface between the SUAV, GCS and PVNT in the 
MCS provided telemetry from the SUAV and sensor way point as well as control 
commands in other directions. 

The HMMWV appears only as a dot in Figure 28 indicating the need for better 
resolution. Also noted was the large variation in background view orientation. The 
frames captured in three second intervals show the view changing by nearly 90 degrees. 

I- 



Figure 28. First Tracking HMMWV on Generals Road 

It should also be emphasized that spot tracking software that follows the black 
feature along the white road was not tracking this vehicle. Instead sensor way points 
were entered on simulated imagery through PVNT along the road at two to three second 
intervals in order to keep visual contact with the vehicle. The images above showed 
considerable buffeting and frame-to-frame reorientation. 

A better example of the tracking problem is shown in the following five frame 
clip. The vehicle passes three trees in the upper right edge of window 2 shown below. It 
is only a small black dot but can be easily seen. For this segment the SUAV is moving in 
a slow arc around a road point. The first three frames are stable with the camera rotating 
slowly around a point close to the tree in the lower center. 

The fifth frame however shows a jump and the three trees suddenly show up close 

to the lower right of the frame. The target is not viewable in this frame. In window six 
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the camera is reoriented toward the lower part of the road, the three trees move up and the 
target vehicle is again in view. 



Figure 29. Second Tracking of HMMWV on Generals Road 


When the features in window two to six are extracted to perform a flat image 
rotation and translation, the features did not quite match due to the lack of elevation and 
projection correction. However, they did match well enough to perform a velocity 
calculation. A similar calculation could be performed by estimating the target 
coordinates in each frame separately and performing the velocity calculation 
mathematically. However, this will require the points to control the camera motion and 
additional points to follow the target. 
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Figure 30. Target Distance Traveled 


The experiments conducted were a qualitative test of the ability to fly the sensor 
and this was accomplished. Quantitative measurements should be taken in follow-on 
experiments to measure the accuracies and identify correctable sources of inaccuracies. 
A vehicle outfitted with GPS capable of recording its location is recommended so that 
comparisons with PVNT generated points can be made. 

3. Image StabUization 

The goal for this experiment was to verify the compatibility of the VICE mosaic 
image stability software with the PVNT interface software in order to demonstrate 
equipment readiness for electronically stabilized image investigations. The CR Interface 
was able to perform mosaic screen capture and synchronize telemetry along with the 
captured image. The CR Interface fixed window proved adequate to capture potential 
target windows and the BMP format conversion and data transfer to the PVNT down 
stream processor was accomplished without overloading the VICE machine. Sufficinet 
screen space on the VICE machine was also verified that it could perform adequate 
feature identification. Overall, video and telemetry interfaces where completed so that 
the VICE workstation acted like a PC Interface device with live video presented on a 
mosaic screen^®. 


A detailed description of the technical modifications is provided in final report entitled: TNT-06-4 
Individual Experiment AAR Executive Summary; Dr. Baer, September, 2006. 
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Figure 26 below shows a screen capture of the VICE mosaic on the right with 
image trail consisting of six screen image captures on the left. Notice that the mosaic 
tends to wander and fill the large screen on the right side. The trigger for a new mosaic 
was a full screen. The VICE software can be set to begin a new mosaic frame every 
second, but this feature could not be automatically set on the available version and 
instead was emulated by hand command. A blow up of the windows captured at a one 
second intervals shows that a fairly well centered picture could be extracted consistently. 
Eigure 31 shows the six trail windows that were captured. 



Eigure 31. Mosaic Screen Capture 
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The reader will note that these six one seeond snapshots still eontain eonsiderable 



Figure 32. Trail Images Captured 

A eonsiderable amount of noise in the form of artifaets was observed in the six 
one seeond snapshots shown in Figure 32. A larger mosaic snapshot is shown below in 
Figure 33 consisting of 10 to 30 slide mosaics. Geographic stability was achieved 
making this a good technique for viewing; however artifacts are still present in areas 
where the frames were overlaid. Visual inspection shows considerable distortion in the 
overlay areas due to edge effects. 
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Figure 33. Large Mosaic 

When converted to black and white and transferred to PVNT a typical picture 
looks like the one shown in Figure 34 below. Although line artifacts are visible over the 
whole picture they are noticeably accentuated in the Mosaic overlay region. Further 
testing will be required to determine if a computer can actually get any advantage out of 
the mosaic image. 
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Figure 34. Black and White in PVNT 
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IX. CONCLUSIONS 


A. SUMMARY 

UAS large and small are here to stay. Sinee the beginning of the Global War on 
Terror (GWOT) in 2001, the U.S. DoD alone has nearly quadrupled its funding for UAS 
making it a two billion dollar per year industry. By 2010 this figure is predieted to grow 
to three billion dollars. The historieal and predieted future relevanee of UAS was 
presented in this thesis. Surveillance, target acquisition and reconnaissance (STAR) 
missions remain the predominant missions that military commanders request UAS to 
perform. Many other areas including electronic attack (EA), Strike and Suppression of 
Enemy Air Defense (SEAD), Communication Relays, and Combat Search and Rescue 
(CSAR) are also expected to be increasingly performed by UAS. 

Several technology gaps, particularly those related to STAR missions, were 
identified. The need for better visual display technologies, better interoperability with 
other systems and the need to consider the operational support needs over the total life of 
the system were addressed. A function versus mission table was provided that listed 
known functions necessary for mission success. It is hoped that this matrix can serve as a 
guide in the development of future flight and mission control support systems (EMCSS). 

An alternative to the current paradigm of designing UAS around the concept of 
putting a pilot’s brain in the cockpit was offered. The concept of “fiy-the-sensor” was 
introduced as a new philosophy to use when designing UAS. The concept shifts the 
emphasis off the pilot and recommends designs centered on flying the sensor instead of 
the UAV. As technology advances allowing more vehicle autonomy, this concept will 
likely permit designs that are less manpower intensive. 

Several potential technology solutions were presented that offer the possibility to 
enhance the likelihood of mission success by reducing the cognitive load on human 
operators. The thesis presented the argument that designers can achieve more bang for 
the buck by expending resources on software solutions over computer or airframe 
hardware solutions. The rapid rate at which of computer hardware technology is 
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advancing has opened up new possibilities for software solutions to perform funetions 
that are currently being handled by humans. 

Finally, two field experiments were conducted to test the feasibility of four 
potential teehnology solutions as they pertain to the design of a SUAS FMCSS. The first 
experiment tested a program that allows synchronized image playback for MCS 
operators. The objective of this experiment was to give the operator more flexibility by 
being able to review video instantly instead of needing to retraek an area that was 
previously observed by the UAV eamera. The second experimented tested a program 
that will allow video from two UAVs to be displayed simultaneously on one monitor. 
This teehnology may eventually enable an operator to effeetively control multiple UAVs 
thus redueing the operator to UAV ratio. The third experiment tested the “fiy-the-sensor” 
concept. The experiment demonstrated that a target could be traeked by telling the sensor 
where to point as opposed to flying the UAV and then pointing the sensor. And finally 
the last experiment tested the possibility of integrating a commercial software produet 
into the MCS to provide image stability. By reducing the jitter of displayed images the 
eognitive load on the mission payload operator can be reduced and enable the 
identifieation of targets to be aecomplished faster. 
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APPENDIX A: LIST OF ACRONYMS 


AVO 

Air Vehicle Operator 

MAE 

Medium Altitude Endurance 

AIAA 

American Institute of Aeronautics and Astronautics 

MAV 

Micro Air Vehicle 

AOI 

Area of Interest 

MCS 

Mission Control Station 

AOR 

Area of Responsibility 

MPO 

Mission Payload Operator 

B/W 

Black and White 

NRT 

Near Real Time 

BA 

Battlespace Awareness 

NPS 

Naval Postgraduate School 

BDA 

Battle Damage Assessment 

NDIA 

National Defense Industrial Association 

BW 

Bandwidth 

MTI 

Moving Target Indioator 

C2 

Command and Control 

NORAD 

North American Aerospace Defense Command 


Command and Control 

OEF 

Operation Enduring Freedom 

C4I 

Command, Control, Communication, Computer and Intelligence 

OIF 

Operation Iraqi Freedom 

COCOM 

Combatant Commander 

NLOS 

Non-Line of Sight 

COP 

Common Operational Picture 

VICE 

Video Imagery Capability Enhancement 

CoT 

Cursor-on-Target 

OPTEMPO 

Operational Tempo 

CR 

Camp Roberts 

NCW 

Network Centric Warfare 

CSAR 

Combat Search and Rescue 

NOHD 

Nominal Ocular Hazard Distance 

DoD 

Department of Defense 

PDA 

Personal Digital Assistant 

EA 

Electronic Attack 

QDR 

Quadrenial Defense Review 

EM 

Electromagnetic 

PVNT 

Perspective View Nascent Technology 

EO 

Electro-Optical 

RADAR 

Radio Detection and Ranging 

FA 

Force Application 

SA 

Situational Awareness 

FL 

Focused Logistics 

SECDEF 

Secretary of Defense 

FLOT 

Forward Line of Troops 

SUAV 

Small Unmanned Air Vehicle 

FMCSS 

Flight and Mission Control Support System 

ROE 

Rules of Engagement 

FOV 

Field of View 

RF 

Radio Frequency 

FP 

Force Protection 

SUAS 

Small Unmanned Aerial System 

Gbps 

Giga Bit per seoond 

SOCOM 

Special Operations Command 

GCS 

Ground Control Station 

SEAD/DEAD 

Suppression of Enemy Air Defense/ 

Destruction of Enemy Air Defense 

GIG 

Global Information Grid 

STANAG 

standardization Agreement 

GWOT 

Global War on Terror 

SME 

Subject Matter Expert 

HALE 

High Altitude Long Endurance 

STAR 

Surveillance Target Acquisition and Reconaissance 

HIL 

Human in the Loop 

TCS 

Taotical Control System 

HMMWV 

High Mobility Multipurpose Wheeled Vehicle 

TOC 

Tactical Operations Center 

IADS 

Integrated Air Defense System 

TNT 

Taotical Network Topology 

IEEE 

Institute of Electrioal and Electronics Engineers 

TUAS 

Tactical Unmanned Aerial Vehicle 

IPL 

Integrated Priority List 

TIPS 

Tactical Image Processing Software 

IR 

Infared 

TCP/IP 

Transport Control Protocol/Internet Protocol 

ISR 

Intelligence, Surveillance and Reconnaissance 

UAV 

Unmanned Aerial Vehicle 

JDAM 

Joint Direct Attack Missile 

UA 

Unmanned Aircraft 

JFC 

Joint Force Commander 

UAS 

Unmanned Aerial System 

JSRC 

Joint Search and Rescue Center 

UCAV 

Unmanned Combat Aerial Vehicle 

LOS 

Line-of-Sight 

UDP 

User Datagram Protocol 

MIO 

Maritime Interdiction Operations 
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